Red Hat Bugzilla – Bug 923992
engine: engine deletes live storage migration destination copy after finish the copy (storage live migration doesn't work)
Last modified: 2016-02-10 12:22:56 EST
Description of problem: engine deletes live storage migration destination copy after finish the copy hence storage live migration doesn't work. managed to reproduce this issue twice so far, vdsm seem to work fine, from some unknown reason engine decides to send deleteImage with destination domain of the new volume copy and its snapshots (revert). attached full logs in case bug is in VDSM (could be!). repro steps: 1) create vm with pre-allocated disk 2) run vm 3) start O.S installation 4) move disk from source domain to dest 5) operation failed. additional information after initial debugging: [root@puma31 ~]# grep -l 5326 /etc/lvm/archive/08221c4d-f68b-4085-ab47-9c1d4b1b70d0_000* | xargs ls -l -rw-------. 1 root root 6717 Mar 20 22:18 /etc/lvm/archive/08221c4d-f68b-4085-ab47-9c1d4b1b70d0_00045-2145444745.vg -rw-------. 1 root root 6717 Mar 20 22:20 /etc/lvm/archive/08221c4d-f68b-4085-ab47-9c1d4b1b70d0_00046-2124975504.vg -rw-------. 1 root root 7272 Mar 20 22:20 /etc/lvm/archive/08221c4d-f68b-4085-ab47-9c1d4b1b70d0_00047-1049148616.vg -rw-------. 1 root root 7272 Mar 20 22:21 /etc/lvm/archive/08221c4d-f68b-4085-ab47-9c1d4b1b70d0_00048-639849343.vg -rw-------. 1 root root 7272 Mar 20 22:21 /etc/lvm/archive/08221c4d-f68b-4085-ab47-9c1d4b1b70d0_00049-2011190022.vg [root@puma31 ~]# grep -l 5326 /etc/lvm/archive/4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7_000* | xargs ls -l -rw-------. 1 root root 6269 Mar 20 22:20 /etc/lvm/archive/4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7_00020-2019345239.vg -rw-------. 1 root root 6269 Mar 20 22:21 /etc/lvm/archive/4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7_00021-997382622.vg -rw-------. 1 root root 6269 Mar 20 22:21 /etc/lvm/archive/4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7_00022-1353084299.vg -rw-------. 1 root root 5628 Mar 20 22:25 /etc/lvm/archive/4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7_00023-813313325.vg -rw-------. 1 root root 5650 Mar 20 22:25 /etc/lvm/archive/4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7_00024-1226565626.vg -rw-------. 1 root root 6291 Mar 20 22:26 /etc/lvm/archive/4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7_00025-1477978184.vg -rw-------. 1 root root 5726 Mar 20 22:26 /etc/lvm/archive/4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7_00026-765188490.vg -rw-------. 1 root root 5726 Mar 20 22:26 /etc/lvm/archive/4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7_00027-1946424831.vg Thread-942::INFO::2013-03-20 22:18:33,436::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='08221c4d-f68b-4085-ab47-9c1d4b1b70d0', spUUID='a31dbbd1-d491-4420-9747-85bbbe15cc25', imgUUID='5c2b6dfa-50b4-4619-8fed-d5afdd96fd4a', size='26843545600', volFormat=5, preallocate=1, diskType=2, volUUID='532646ab-1dc2-405b-9c8a-21a403106eba', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') Thread-942::INFO::2013-03-20 22:18:33,830::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None Thread-951::INFO::2013-03-20 22:18:43,809::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='1d14b57a-14f0-4329-af30-089c39dde44b', spUUID=None, options=None) Thread-951::INFO::2013-03-20 22:18:43,814::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None Thread-1012::INFO::2013-03-20 22:20:21,042::logUtils::37::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='08221c4d-f68b-4085-ab47-9c1d4b1b70d0', spUUID='a31dbbd1-d491-4420-9747-85bbbe15cc25', imgUUID='5c2b6dfa-50b4-4619-8fed-d5afdd96fd4a', size='26843545600', volFormat=4, preallocate=2, diskType=2, volUUID='f33630f3-3e69-49d1-8114-599fbadf73d3', desc='', srcImgUUID='5c2b6dfa-50b4-4619-8fed-d5afdd96fd4a', srcVolUUID='532646ab-1dc2-405b-9c8a-21a403106eba') Thread-1012::INFO::2013-03-20 22:20:21,443::logUtils::39::dispatcher::(wrapper) Run and protect: createVolume, Return response: None Thread-1030::INFO::2013-03-20 22:20:44,848::logUtils::37::dispatcher::(wrapper) Run and protect: cloneImageStructure(spUUID='a31dbbd1-d491-4420-9747-85bbbe15cc25', sdUUID='08221c4d-f68b-4085-ab47-9c1d4b1b70d0', imgUUID='5c2b6dfa-50b4-4619-8fed-d5afdd96fd4a', dstSdUUID='4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7') Thread-1030::INFO::2013-03-20 22:20:45,642::logUtils::39::dispatcher::(wrapper) Run and protect: cloneImageStructure, Return response: None Thread-1031::INFO::2013-03-20 22:20:45,716::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='cc0820b2-21d3-4322-b936-92879431a60c', spUUID=None, options=None) Thread-1031::INFO::2013-03-20 22:20:45,718::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None Thread-1038::INFO::2013-03-20 22:20:54,016::logUtils::37::dispatcher::(wrapper) Run and protect: syncImageData(spUUID='a31dbbd1-d491-4420-9747-85bbbe15cc25', sdUUID='08221c4d-f68b-4085-ab47-9c1d4b1b70d0', imgUUID='5c2b6dfa-50b4-4619-8fed-d5afdd96fd4a', dstSdUUID='4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7', syncType='INTERNAL') Thread-1038::INFO::2013-03-20 22:20:54,821::logUtils::39::dispatcher::(wrapper) Run and protect: syncImageData, Return response: None Thread-1040::INFO::2013-03-20 22:20:54,908::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='3584f927-9bca-47f2-91db-7b9aa2c58295', spUUID=None, options=None) Thread-1040::INFO::2013-03-20 22:20:54,910::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None Thread-1200::INFO::2013-03-20 22:24:44,462::logUtils::37::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='4b14d3b3-7da4-4ed5-88d0-bfb31f3b8df7', spUUID='a31dbbd1-d491-4420-9747-85bbbe15cc25', imgUUID='5c2b6dfa-50b4-4619-8fed-d5afdd96fd4a', postZero='true', force='false') Thread-1200::INFO::2013-03-20 22:24:45,100::logUtils::39::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None Thread-1201::INFO::2013-03-20 22:24:45,191::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='05dc4dde-047c-4366-ad81-9e765f30f6a4', spUUID=None, options=None) Thread-1201::INFO::2013-03-20 22:24:45,193::logUtils::39::dispatcher::(wrapper) Run and protect: clearTask, Return response: None Thread-1279::INFO::2013-03-20 22:26:34,828::logUtils::37::dispatcher::(wrapper) Run and protect: clearTask(taskID='fdf59ca5-9a18-46cc-81b4-780d3d14638b', spUUID=None, options=None)
Created attachment 713477 [details] engine.log
Created attachment 713478 [details] vdsm log - spm
Created attachment 713479 [details] vdsm log - hsm
any reason bug is in post without external tracker?
http://gerrit.ovirt.org/#/c/13242/ (can't seem to add the external tracker)
verified on sf13
*** Bug 962579 has been marked as a duplicate of this bug. ***
*** Bug 967887 has been marked as a duplicate of this bug. ***
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. http://rhn.redhat.com/errata/RHSA-2013-0888.html