Bug 1119023

Summary: Live Storage fails to start,hence,throws several exceptions from the beginning.(the UI remains indifferent)
Product: [Retired] oVirt Reporter: Ori Gofen <ogofen>
Component: ovirt-engine-coreAssignee: Allon Mureinik <amureini>
Status: CLOSED DUPLICATE QA Contact: Pavel Stehlik <pstehlik>
Severity: high Docs Contact:
Priority: unspecified    
Version: 3.5CC: acanan, acathrow, amureini, gklein, iheim, yeylon
Target Milestone: ---Keywords: Triaged
Target Release: 3.5.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard: storage
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2014-07-13 12:49:47 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Storage RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
vdsm+engine logs none

Description Ori Gofen 2014-07-13 09:05:08 UTC
Created attachment 917601 [details]
vdsm+engine logs

Description of problem:
The Operation of Live storage migration fails every single time while the UI remains indifferent through the whole process,it doesn't report on the command nor the failure,actually nothing happens.

from engine's log:

2014-07-13 11:41:57,401 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugDiskVDSCommand] (org.ovirt.thread.pool-8-thread-49) [7b1c934f] Failed in HotPlugDiskVDS method
2014-07-13 11:41:57,402 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugDiskVDSCommand] (org.ovirt.thread.pool-8-thread-49) [7b1c934f] Command org.ovirt.engine.core.vdsbroker.vdsbro
ker.HotPlugDiskVDSCommand return value 
 StatusOnlyReturnForXmlRpc [mStatus=StatusForXmlRpc [mCode=45, mMessage=internal error unable to execute QEMU command 'device_add': Device 'virtio-blk-pci' could not be initialized]]
2014-07-13 11:41:57,409 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugDiskVDSCommand] (org.ovirt.thread.pool-8-thread-49) [7b1c934f] HostName = vdsc
2014-07-13 11:41:57,413 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugDiskVDSCommand] (org.ovirt.thread.pool-8-thread-49) [7b1c934f] Command HotPlugDiskVDSCommand(HostName = vdsc,
 HostId = 112cf100-f097-4dcd-9872-b74f6a94f191, vmId=d60cdfd1-bcfe-47de-ae47-01da178aa8f4, diskId = 201ff497-e5d8-4230-bab3-47328ea73085) execution failed. Exception: VDSErrorException: VDS
GenericException: VDSErrorException: Failed to HotPlugDiskVDS, error = internal error unable to execute QEMU command 'device_add': Device 'virtio-blk-pci' could not be initialized, code = 4
5
2014-07-13 11:41:57,427 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugDiskVDSCommand] (org.ovirt.thread.pool-8-thread-49) [7b1c934f] FINISH, HotPlugDiskVDSCommand, log id: 1a411dc
e
2014-07-13 11:41:57,432 ERROR [org.ovirt.engine.core.bll.HotPlugDiskToVmCommand] (org.ovirt.thread.pool-8-thread-49) [7b1c934f] Command org.ovirt.engine.core.bll.HotPlugDiskToVmCommand thro
w Vdc Bll exception. With error message VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotPlugDiskVDS, error
 = internal error unable to execute QEMU command 'device_add': Device 'virtio-blk-pci' could not be initialized, code = 45 (Failed with error FailedToPlugDisk and code 45)
2014-07-13 11:41:57,460 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-49) [7b1c934f] Correlation ID: 7b1c934f, Call Stack: nul
l, Custom Event ID: -1, Message: Failed to plug disk vm_1_Disk2 to VM vm_1 (User: admin).
2014-07-13 11:41:57,462 INFO  [org.ovirt.engine.core.bll.HotPlugDiskToVmCommand] (org.ovirt.thread.pool-8-thread-49) [7b1c934f] Lock freed to object EngineLock [exclusiveLocks= key: 201ff49
7-e5d8-4230-bab3-47328ea73085 value: DISK
, sharedLocks= key: d60cdfd1-bcfe-47de-ae47-01da178aa8f4 value: VM
]
2014-07-13 11:42:16,522 INFO  [org.ovirt.engine.core.bll.MoveDisksCommand] (ajp--127.0.0.1-8702-8) [24077461] Running command: MoveDisksCommand internal: false. Entities affected :  ID: 7fa
b6e09-4b54-4bde-a90a-6c6162b58684 Type: Disk
2014-07-13 11:42:16,531 ERROR [org.ovirt.engine.core.bll.CommandsFactory] (ajp--127.0.0.1-8702-8) [24077461] Cant find constructor for type org.ovirt.engine.core.bll.lsm.LiveMigrateVmDisksC
ommand with parameter types: [class org.ovirt.engine.core.common.action.LiveMigrateVmDisksParameters]
2014-07-13 11:42:16,534 ERROR [org.ovirt.engine.core.bll.CommandsFactory] (ajp--127.0.0.1-8702-8) [24077461] An exception has occured while trying to create a command object for command Liv
eMigrateVmDisks: java.lang.RuntimeException: could not find matching constructor for Command class class org.ovirt.engine.core.bll.lsm.LiveMigrateVmDisksCommand
        at org.ovirt.engine.core.bll.CommandsFactory.findCommandConstructor(CommandsFactory.java:197) [bll.jar:]
        at org.ovirt.engine.core.bll.CommandsFactory.createCommand(CommandsFactory.java:61) [bll.jar:]
        at org.ovirt.engine.core.bll.CommandsFactory.createCommand(CommandsFactory.java:53) [bll.jar:]
        at org.ovirt.engine.core.bll.MultipleActionsRunner.execute(MultipleActionsRunner.java:64) [bll.jar:]
        at org.ovirt.engine.core.bll.Backend.runMultipleActionsImpl(Backend.java:547) [bll.jar:] etc.

 After several attempts to live-migrate my nfs domain even became Inactive

2014-07-13 11:57:49,739 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsProxyData] (org.ovirt.thread.pool-8-thread-13) Domain 8145c04e-a0e8-4462-b5bb-720a22e832be:nfs_1 was reported by all hosts in status UP as problematic. Moving the domain to NonOperational.

Version-Release number of selected component (if applicable):
alpha2

How reproducible:
100%

Steps to Reproduce:
1.live migrate disk(try on Block and File)

Actual results:
operation fails with exceptions while UI remains indifferent through the whole process 

Expected results:
operation should succeed 

Additional info:

Comment 1 Allon Mureinik 2014-07-13 12:49:47 UTC
The relevant failure is the inability to find a constructor:

2014-07-13 11:42:16,534 ERROR [org.ovirt.engine.core.bll.CommandsFactory] (ajp--127.0.0.1-8702-8) [24077461] An exception has occured while trying to create a command object for command Liv
eMigrateVmDisks: java.lang.RuntimeException: could not find matching constructor for Command class class org.ovirt.engine.core.bll.lsm.LiveMigrateVmDisksCommand
        at org.ovirt.engine.core.bll.CommandsFactory.findCommandConstructor(CommandsFactory.java:197) [bll.jar:]
        at org.ovirt.engine.core.bll.CommandsFactory.createCommand(CommandsFactory.java:61) [bll.jar:]
        at org.ovirt.engine.core.bll.CommandsFactory.createCommand(CommandsFactory.java:53) [bll.jar:]
        at org.ovirt.engine.core.bll.MultipleActionsRunner.execute(MultipleActionsRunner.java:64) [bll.jar:]
        at org.ovirt.engine.core.bll.Backend.runMultipleActionsImpl(Backend.java:547) [bll.jar:] etc.

*** This bug has been marked as a duplicate of bug 1116031 ***