Bug 660598

Summary: [vdsm] failed migration leaves vm in pause although qemu is already dead
Product: Red Hat Enterprise Linux 6 Reporter: Haim <hateya>
Component: vdsmAssignee: Eduardo Warszawski <ewarszaw>
Status: CLOSED ERRATA QA Contact: yeylon <yeylon>
Severity: high Docs Contact:
Priority: low    
Version: 6.1CC: abaron, bazulay, danken, dnaori, hateya, iheim, mgoldboi, Rhev-m-bugs, srevivo, yeylon, ykaul
Target Milestone: rc   
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: vdsm-4.9-51 Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2011-12-06 07:03:23 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
vdsm log on source server none

Description Haim 2010-12-07 09:29:12 UTC
Created attachment 465205 [details]
vdsm log on source server

Description of problem:

failed migration leaves vm in pause state although qemu process died during that process. 

 [root@nott-vds4 ~]# vdsClient -s 0 list table
940341c9-7074-4f20-9de1-dd05e295d0f2  14237  fedora13-pool-05     Paused 


[root@nott-vds4 ~]# virsh list
 Id Name                 State
----------------------------------

Thread-40786::DEBUG::2010-12-07 10:31:39,110::clientIF::40::vds::(wrapper) [10.35.70.2]::call migrate with ({'src': 'nott-vds4.qa.lab.tlv.redhat.com', 'dst': '
nott-vds1.qa.lab.tlv.redhat.com:54321', 'vmId': '940341c9-7074-4f20-9de1-dd05e295d0f2', 'method': 'online'},) {}
Thread-40786::DEBUG::2010-12-07 10:31:39,111::clientIF::334::vds::(migrate) {'src': 'nott-vds4.qa.lab.tlv.redhat.com', 'dst': 'nott-vds1.qa.lab.tlv.redhat.com:
54321', 'vmId': '940341c9-7074-4f20-9de1-dd05e295d0f2', 'method': 'online'}
Thread-40787::DEBUG::2010-12-07 10:31:39,113::vm::261::vds.vmlog.940341c9-7074-4f20-9de1-dd05e295d0f2::(_setupVdsConnection) Destination server is: https://not
t-vds1.qa.lab.tlv.redhat.com:54321
Thread-40786::DEBUG::2010-12-07 10:31:39,113::clientIF::45::vds::(wrapper) return migrate with {'status': {'message': 'Migration process starting', 'code': 0}}
Thread-40787::DEBUG::2010-12-07 10:31:39,113::vm::263::vds.vmlog.940341c9-7074-4f20-9de1-dd05e295d0f2::(_setupVdsConnection) Initiating connection with destina
tion
Thread-40785::DEBUG::2010-12-07 10:31:39,142::vm::317::vds.vmlog.ea8d9158-5255-49bb-8c06-acdd2b5a3210::(_prepareGuest) migration Process begins

Thread-40787::ERROR::2010-12-07 10:31:39,421::vm::325::vds.vmlog.940341c9-7074-4f20-9de1-dd05e295d0f2::(_recover) Domain not found: no domain with matching uuid '940341c9-7074-4f20-9de1-dd05e295d0f2'
Thread-40787::ERROR::2010-12-07 10:31:39,512::vm::451::vds.vmlog.940341c9-7074-4f20-9de1-dd05e295d0f2::(run) Traceback (most recent call last):
  File "/usr/share/vdsm/vm.py", line 430, in run
    self._setupRemoteMachineParams()
  File "/usr/share/vdsm/libvirtvm.py", line 89, in _setupRemoteMachineParams
    self._machineParams['_srcDomXML'] = self._vm._dom.XMLDesc(0)
  File "/usr/share/vdsm/libvirtvm.py", line 146, in f
    raise e
libvirtError: Domain not found: no domain with matching uuid '940341c9-7074-4f20-9de1-dd05e295d0f2'


destination server: 


Thread-47125::DEBUG::2010-12-07 10:28:40,979::clientIF::40::vds::(wrapper) [10.35.115.13]::call getVmStats with ('940341c9-7074-4f20-9de1-dd05e295d0f2',) {}
Thread-47125::DEBUG::2010-12-07 10:28:40,981::clientIF::45::vds::(wrapper) return getVmStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}}


Thread-47135::DEBUG::2010-12-07 10:28:41,119::clientIF::40::vds::(wrapper) [10.35.115.13]::call destroy with ('940341c9-7074-4f20-9de1-dd05e295d0f2',) {}
Thread-47135::DEBUG::2010-12-07 10:28:41,120::clientIF::45::vds::(wrapper) return destroy with {'status': {'message': 'Virtual machine does not exist', 'code': 1}}



problem is i can't tell why it failed on destination server, as libvirt logs are not sufficient. 

repro steps (not conclusive)

1) perform migration 



vdsm-4.9-28.el6.x86_64
libvirt-0.8.1-28.el6.x86_64
kernel-2.6.32-71.7.1.el6.x86_64
[root@nott-vds2 ~]#

Comment 3 David Naori 2011-02-28 16:54:13 UTC
Verfied on vdsm-4.9-51

Comment 4 errata-xmlrpc 2011-12-06 07:03:23 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

http://rhn.redhat.com/errata/RHEA-2011-1782.html