Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 923992

Summary: engine: engine deletes live storage migration destination copy after finish the copy (storage live migration doesn't work)
Product: Red Hat Enterprise Virtualization Manager Reporter: Haim <hateya>
Component: ovirt-engineAssignee: Daniel Erez <derez>
Status: CLOSED ERRATA QA Contact: Dafna Ron <dron>
Severity: urgent Docs Contact:
Priority: urgent    
Version: 3.2.0CC: abaron, acathrow, amureini, dyasny, iheim, kbooth, lpeer, lyarwood, nachandr, Rhev-m-bugs, scohen, yeylon, ykaul
Target Milestone: ---Flags: abaron: Triaged+
Target Release: 3.2.0   
Hardware: x86_64   
OS: Linux   
Whiteboard: storage
Fixed In Version: sf12 Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2013-06-10 21:37:46 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Storage RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
engine.log
none
vdsm log - spm
none
vdsm log - hsm none

Description Haim 2013-03-20 21:16:38 UTC
Description of problem:

engine deletes live storage migration destination copy after finish the copy hence storage live migration doesn't work.

managed to reproduce this issue twice so far, vdsm seem to work fine, from some unknown reason engine decides to send deleteImage with destination domain of the new volume copy and its snapshots (revert).

attached full logs in case bug is in VDSM (could be!).

repro steps:

1) create vm with pre-allocated disk
2) run vm
3) start O.S installation
4) move disk from source domain to dest
5) operation failed.

additional information after initial debugging:

[root@puma31 ~]# grep -l 5326  /etc/lvm/archive/08221c4d-f68b-4085-ab47-9c1d4b1b70d0_000* | xargs ls -l
-rw-------. 1 root root 6717 Mar 20 22:18 /etc/lvm/archive/08221c4d-f68b-4085-ab47-9c1d4b1b70d0_00045-2145444745.vg
-rw-------. 1 root root 6717 Mar 20 22:20 /etc/lvm/archive/08221c4d-f68b-4085-ab47-9c1d4b1b70d0_00046-2124975504.vg
-rw-------. 1 root root 7272 Mar 20 22:20 /etc/lvm/archive/08221c4d-f68b-4085-ab47-9c1d4b1b70d0_00047-1049148616.vg
-rw-------. 1 root root 7272 Mar 20 22:21 /etc/lvm/archive/08221c4d-f68b-4085-ab47-9c1d4b1b70d0_00048-639849343.vg
-rw-------. 1 root root 7272 Mar 20 22:21 /etc/lvm/archive/08221c4d-f68b-4085-ab47-9c1d4b1b70d0_00049-2011190022.vg
[root@puma31 ~]# grep -l 5326  /etc/lvm/archive/4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7_000* | xargs ls -l
-rw-------. 1 root root 6269 Mar 20 22:20 /etc/lvm/archive/4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7_00020-2019345239.vg
-rw-------. 1 root root 6269 Mar 20 22:21 /etc/lvm/archive/4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7_00021-997382622.vg
-rw-------. 1 root root 6269 Mar 20 22:21 /etc/lvm/archive/4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7_00022-1353084299.vg
-rw-------. 1 root root 5628 Mar 20 22:25 /etc/lvm/archive/4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7_00023-813313325.vg
-rw-------. 1 root root 5650 Mar 20 22:25 /etc/lvm/archive/4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7_00024-1226565626.vg
-rw-------. 1 root root 6291 Mar 20 22:26 /etc/lvm/archive/4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7_00025-1477978184.vg
-rw-------. 1 root root 5726 Mar 20 22:26 /etc/lvm/archive/4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7_00026-765188490.vg
-rw-------. 1 root root 5726 Mar 20 22:26 /etc/lvm/archive/4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7_00027-1946424831.vg


Thread-942::INFO::2013-03-20 22:18:33,436::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='08221c4d-f68b-4085-ab47-9c1d4b1b70d0', spUUID='a31dbbd1-d491-4420-9747-85bbbe15cc25', imgUUID='5c2b6dfa-50b4-4619-8fed-d5afdd96fd4a', size='26843545600', volFormat=5, preallocate=1, diskType=2, volUUID='532646ab-1dc2-405b-9c8a-21a403106eba', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000')
Thread-942::INFO::2013-03-20 22:18:33,830::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None
Thread-951::INFO::2013-03-20 22:18:43,809::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='1d14b57a-14f0-4329-af30-089c39dde44b', spUUID=None, options=None)
Thread-951::INFO::2013-03-20 22:18:43,814::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None
Thread-1012::INFO::2013-03-20 22:20:21,042::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='08221c4d-f68b-4085-ab47-9c1d4b1b70d0', spUUID='a31dbbd1-d491-4420-9747-85bbbe15cc25', imgUUID='5c2b6dfa-50b4-4619-8fed-d5afdd96fd4a', size='26843545600', volFormat=4, preallocate=2, diskType=2, volUUID='f33630f3-3e69-49d1-8114-599fbadf73d3', desc='', srcImgUUID='5c2b6dfa-50b4-4619-8fed-d5afdd96fd4a', srcVolUUID='532646ab-1dc2-405b-9c8a-21a403106eba')
Thread-1012::INFO::2013-03-20 22:20:21,443::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None
Thread-1030::INFO::2013-03-20 22:20:44,848::logUtils::37::dispatcher::(wrapper) Run and protect: cloneImageStructure(spUUID='a31dbbd1-d491-4420-9747-85bbbe15cc25', sdUUID='08221c4d-f68b-4085-ab47-9c1d4b1b70d0', imgUUID='5c2b6dfa-50b4-4619-8fed-d5afdd96fd4a', dstSdUUID='4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7')
Thread-1030::INFO::2013-03-20 22:20:45,642::logUtils::39::dispatcher::(wrapper) Run and protect: cloneImageStructure, Return response: None
Thread-1031::INFO::2013-03-20 22:20:45,716::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='cc0820b2-21d3-4322-b936-92879431a60c', spUUID=None, options=None)
Thread-1031::INFO::2013-03-20 22:20:45,718::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None
Thread-1038::INFO::2013-03-20 22:20:54,016::logUtils::37::dispatcher::(wrapper) Run and protect: syncImageData(spUUID='a31dbbd1-d491-4420-9747-85bbbe15cc25', sdUUID='08221c4d-f68b-4085-ab47-9c1d4b1b70d0', imgUUID='5c2b6dfa-50b4-4619-8fed-d5afdd96fd4a', dstSdUUID='4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7', syncType='INTERNAL')
Thread-1038::INFO::2013-03-20 22:20:54,821::logUtils::39::dispatcher::(wrapper) Run and protect: syncImageData, Return response: None
Thread-1040::INFO::2013-03-20 22:20:54,908::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='3584f927-9bca-47f2-91db-7b9aa2c58295', spUUID=None, options=None)
Thread-1040::INFO::2013-03-20 22:20:54,910::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None
Thread-1200::INFO::2013-03-20 22:24:44,462::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7', spUUID='a31dbbd1-d491-4420-9747-85bbbe15cc25', imgUUID='5c2b6dfa-50b4-4619-8fed-d5afdd96fd4a', postZero='true', force='false')
Thread-1200::INFO::2013-03-20 22:24:45,100::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None
Thread-1201::INFO::2013-03-20 22:24:45,191::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='05dc4dde-047c-4366-ad81-9e765f30f6a4', spUUID=None, options=None)
Thread-1201::INFO::2013-03-20 22:24:45,193::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None
Thread-1279::INFO::2013-03-20 22:26:34,828::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='fdf59ca5-9a18-46cc-81b4-780d3d14638b', spUUID=None, options=None)

Comment 1 Haim 2013-03-20 21:24:53 UTC
Created attachment 713477 [details]
engine.log

Comment 2 Haim 2013-03-20 21:25:29 UTC
Created attachment 713478 [details]
vdsm log - spm

Comment 3 Haim 2013-03-20 21:26:06 UTC
Created attachment 713479 [details]
vdsm log - hsm

Comment 4 Haim 2013-03-24 08:54:04 UTC
any reason bug is in post without external tracker?

Comment 5 Daniel Erez 2013-03-24 09:09:23 UTC
http://gerrit.ovirt.org/#/c/13242/
(can't seem to add the external tracker)

Comment 6 Dafna Ron 2013-04-08 12:44:52 UTC
verified on sf13

Comment 7 Daniel Erez 2013-05-22 16:11:47 UTC
*** Bug 962579 has been marked as a duplicate of this bug. ***

Comment 8 Daniel Erez 2013-05-28 15:00:13 UTC
*** Bug 967887 has been marked as a duplicate of this bug. ***

Comment 9 errata-xmlrpc 2013-06-10 21:37:46 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

http://rhn.redhat.com/errata/RHSA-2013-0888.html