Bug 998280

Summary: During commit a snapshot get error - live merge completed for an unexpected path
Product: Red Hat Enterprise Virtualization Manager Reporter: vvyazmin <vvyazmin>
Component: vdsmAssignee: Federico Simoncelli <fsimonce>
Status: CLOSED DUPLICATE QA Contact: vvyazmin <vvyazmin>
Severity: low Docs Contact:
Priority: unspecified    
Version: 3.3.0CC: abaron, bazulay, fsimonce, hateya, iheim, lpeer, yeylon
Target Milestone: ---Keywords: Triaged
Target Release: 3.3.0   
Hardware: x86_64   
OS: Linux   
Whiteboard: storage
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2013-09-02 20:54:47 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Storage RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
## Logs rhevm, vdsm, libvirt, thread dump, superVdsm none

Description vvyazmin@redhat.com 2013-08-18 21:10:17 UTC
Created attachment 787848 [details]
## Logs rhevm, vdsm, libvirt, thread dump, superVdsm

Description of problem:
During commit a snapshot get error - live merge completed for an unexpected path

Version-Release number of selected component (if applicable):
RHEVM 3.3 - IS10 environment:

RHEVM:  rhevm-3.3.0-0.15.master.el6ev.noarch
PythonSDK:  rhevm-sdk-python-3.3.0.10-1.el6ev.noarch
VDSM:  vdsm-4.12.0-61.git8178ec2.el6ev.x86_64
LIBVIRT:  libvirt-0.10.2-18.el6_4.9.x86_64
QEMU & KVM:  qemu-kvm-rhev-0.12.1.2-2.355.el6_4.5.x86_64
SANLOCK:  sanlock-2.8-1.el6.x86_64

How reproducible:
100%

Steps to Reproduce:
Create VM with one or more disk
Create a snapshot
Preview a snapshot
Commit the snapshot
Successfully finish task

Actual results:
Get an error: Live merge completed for an unexpected path

Expected results:
No error should be found

Impact on user:
none

Workaround:
not relevant

Additional info:

/var/log/ovirt-engine/engine.log

/var/log/vdsm/vdsm.log

libvirtEventLoop::ERROR::2013-08-18 20:05:35,855::vm::3784::vm.Vm::(_onBlockJobEvent) vmId=`3ed567d0-9028-4b14-aec2-0c9d8b52aa7e`::Live merge completed for an unexpected path: /
rhev/data-center/1e157529-0537-4696-8a6d-9b4be4680e44/561ce535-9830-49a3-975b-ac5fa2915cce/images/fd32317c-2c3f-4dfe-bf77-23bb2c1b878f/5c1fe0d2-44de-486d-9f40-885ef618f33f

Comment 1 Federico Simoncelli 2013-08-20 08:50:35 UTC
(In reply to vvyazmin from comment #0)
> Steps to Reproduce:
> Create VM with one or more disk
> Create a snapshot
> Preview a snapshot
> Commit the snapshot
> Successfully finish task

The steps are incomplete, the issue is related to a live storage migration command issued at:

2013-08-14 17:01:57,633 INFO  [org.ovirt.engine.core.bll.lsm.LiveMigrateVmDisksCommand] (pool-5-thread-43) [6ab44879] Running command: LiveMigrateVmDisksCommand Task handler: LiveSnapshotTaskHandler internal: false. Entities affected :  ID: fb5f8061-5b3c-4263-963d-2e5ea8f3ff57 Type: Disk,  ID: f29f1f15-944f-4f49-a59d-41e41ff57e8a Type: Storage

The "Live merge completed for an unexpected path" error is a text-only issue triggered by the fact that libvirt uses the same event for the disk replica and live merge.

Comment 2 Ayal Baron 2013-08-21 05:14:47 UTC
(In reply to Federico Simoncelli from comment #1)
> (In reply to vvyazmin from comment #0)
> > Steps to Reproduce:
> > Create VM with one or more disk
> > Create a snapshot
> > Preview a snapshot
> > Commit the snapshot
> > Successfully finish task
> 
> The steps are incomplete, the issue is related to a live storage migration
> command issued at:
> 
> 2013-08-14 17:01:57,633 INFO 
> [org.ovirt.engine.core.bll.lsm.LiveMigrateVmDisksCommand] (pool-5-thread-43)
> [6ab44879] Running command: LiveMigrateVmDisksCommand Task handler:
> LiveSnapshotTaskHandler internal: false. Entities affected :  ID:
> fb5f8061-5b3c-4263-963d-2e5ea8f3ff57 Type: Disk,  ID:
> f29f1f15-944f-4f49-a59d-41e41ff57e8a Type: Storage
> 
> The "Live merge completed for an unexpected path" error is a text-only issue
> triggered by the fact that libvirt uses the same event for the disk replica
> and live merge.

So is this a libvirt bug?
Is there anything that failed?

Comment 3 Federico Simoncelli 2013-08-21 18:14:22 UTC
(In reply to Ayal Baron from comment #2)
> (In reply to Federico Simoncelli from comment #1)
> > (In reply to vvyazmin from comment #0)
> > > Steps to Reproduce:
> > > Create VM with one or more disk
> > > Create a snapshot
> > > Preview a snapshot
> > > Commit the snapshot
> > > Successfully finish task
> > 
> > The steps are incomplete, the issue is related to a live storage migration
> > command issued at:
> > 
> > 2013-08-14 17:01:57,633 INFO 
> > [org.ovirt.engine.core.bll.lsm.LiveMigrateVmDisksCommand] (pool-5-thread-43)
> > [6ab44879] Running command: LiveMigrateVmDisksCommand Task handler:
> > LiveSnapshotTaskHandler internal: false. Entities affected :  ID:
> > fb5f8061-5b3c-4263-963d-2e5ea8f3ff57 Type: Disk,  ID:
> > f29f1f15-944f-4f49-a59d-41e41ff57e8a Type: Storage
> > 
> > The "Live merge completed for an unexpected path" error is a text-only issue
> > triggered by the fact that libvirt uses the same event for the disk replica
> > and live merge.
> 
> So is this a libvirt bug?
> Is there anything that failed?

Nothing failed and what happened is by design as far as I understand: libvirt fires an event at the end of a blockjob.
Live storage migration has been implemented on top of blockjob and therefore we now need to add some logic to understand what the event is referring to.

Comment 4 Ayal Baron 2013-09-02 15:10:16 UTC
Fede, isn't this a dup of bug 878975 ?
If so, please close.

Comment 5 Federico Simoncelli 2013-09-02 20:54:47 UTC
(In reply to Ayal Baron from comment #4)
> Fede, isn't this a dup of bug 878975 ?
> If so, please close.

Ah yes it is. I had the feeling there was one already but I couldn't find it.

*** This bug has been marked as a duplicate of bug 878975 ***