Bug 872277 - 3.2 vdsm: cannot migrate VM after live storage migration
Summary: 3.2 vdsm: cannot migrate VM after live storage migration
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Red Hat Enterprise Virtualization Manager
Classification: Red Hat
Component: vdsm
Version: 3.2.0
Hardware: x86_64
OS: Linux
high
high
Target Milestone: ---
: 3.2.0
Assignee: Amador Pahim
QA Contact: Dafna Ron
URL:
Whiteboard: virt
Depends On: 913253
Blocks: 885777 891351 915537
TreeView+ depends on / blocked
 
Reported: 2012-11-01 17:29 UTC by Dafna Ron
Modified: 2018-12-02 18:08 UTC (History)
12 users (show)

Fixed In Version: vdsm-4.10.2-3
Doc Type: Bug Fix
Doc Text:
Clone Of:
: 891351 (view as bug list)
Environment:
Last Closed:
oVirt Team: ---
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)
logs (988.66 KB, application/x-gzip)
2012-11-01 17:29 UTC, Dafna Ron
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Red Hat Knowledge Base (Solution) 285373 0 None None None Never
oVirt gerrit 9139 0 None None None Never

Description Dafna Ron 2012-11-01 17:29:48 UTC
Created attachment 636752 [details]
logs

Description of problem:

I could not migrate a vm after live storage migration with error: 

libvirtError: Requested operation is not valid: cannot migrate domain with 1 snapshots

Version-Release number of selected component (if applicable):

si23
vdsm-4.9.6-40.0.el6_3.x86_64

How reproducible:

100%

Steps to Reproduce:
1. create and run a vm (I had iscsi storage). 
2. move disk
3. after the move finishes migrate vm
  
Actual results:

we fail to migrate the vm:

libvirtError: Requested operation is not valid: cannot migrate domain with 1 snapshots

Expected results:

we should be able to migrate the vm 

Additional info: logs

Comment 1 Itamar Heim 2012-11-01 17:35:57 UTC
is the vm useable after shutdown/restart and can then be live migrated?
(i.e., is the issue transient and goes away on restart of the vm)

Comment 2 Dafna Ron 2012-11-01 17:46:56 UTC
after I shut down the vm and re-run it I can migrate to the second host.

Comment 3 Amador Pahim 2012-11-05 01:16:03 UTC
Some additional information:


- Before live storage migration:

virsh # list --all
 Id    Name                           State
----------------------------------------------------
 3     vm01                           running

virsh # snapshot-list vm01 
 Name                 Creation Time             State         
------------------------------------------------------------


- Live storage migration successful. After live storage migration:

virsh # snapshot-list vm01
 Name                 Creation Time             State         
------------------------------------------------------------
 1352073732           2012-11-05 00:02:12 +0000 disk-snapshot


- Trying to migrate VM:

Thread-5793::ERROR::2012-11-04 23:04:44,000::vm::262::vm.Vm::(run) vmId=`36e3dbd3-4495-475a-901f-054feeb066a8`::Failed to migrate
Traceback (most recent call last):
  File "/usr/share/vdsm/vm.py", line 245, in run
  File "/usr/share/vdsm/libvirtvm.py", line 478, in _startUnderlyingMigration
  File "/usr/share/vdsm/libvirtvm.py", line 518, in f
  File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 83, in wrapper
  File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1104, in migrateToURI2
libvirtError: Requested operation is not valid: cannot migrate domain with 1 snapshots


- After migration error, can't connect to VM console:

Thread-6039::ERROR::2012-11-04 23:11:00,000::BindingXMLRPC::903::vds::(wrapper) libvirt error
Traceback (most recent call last):
  File "/usr/share/vdsm/BindingXMLRPC.py", line 899, in wrapper
  File "/usr/share/vdsm/BindingXMLRPC.py", line 232, in vmSetTicket
  File "/usr/share/vdsm/API.py", line 536, in setTicket
  File "/usr/share/vdsm/libvirtvm.py", line 2196, in setTicket
  File "/usr/share/vdsm/libvirtvm.py", line 526, in f
TimeoutError: Timed out during operation: cannot acquire state change lock


- Because of migration failure, we are affected by:
https://bugzilla.redhat.com/show_bug.cgi?id=676205


- Trying to manually remove snapshot :

virsh # snapshot-delete vm01 --snapshotname 1352073732
error: Failed to delete snapshot 1352073732
error: unsupported configuration: deletion of 1 external disk snapshots not supported yet


- Shutting down and starting VM again, no snapshot is showed in virsh:

virsh # snapshot-list vm01 
 Name                 Creation Time             State         
------------------------------------------------------------


- And migration works well.

Comment 4 Amador Pahim 2012-11-09 18:22:09 UTC
Proposed patch:
http://gerrit.ovirt.org/9139

Comment 9 Dafna Ron 2013-02-20 17:54:49 UTC
blocked: https://bugzilla.redhat.com/show_bug.cgi?id=913253

Comment 12 Dafna Ron 2013-04-08 06:11:04 UTC
verified on sf13 vdsm-4.10.2-14.0.el6ev.x86_64

Comment 13 Itamar Heim 2013-06-11 09:47:00 UTC
3.2 has been released

Comment 14 Itamar Heim 2013-06-11 09:47:10 UTC
3.2 has been released

Comment 15 Itamar Heim 2013-06-11 09:56:38 UTC
3.2 has been released


Note You need to log in before you can comment on or make changes to this bug.