Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1437056

Summary: VM with lease fails to start in Run Once mode
Product: [oVirt] ovirt-engine Reporter: Carlos Mestre González <cmestreg>
Component: BLL.StorageAssignee: Eyal Shenitzky <eshenitz>
Status: CLOSED DUPLICATE QA Contact: Raz Tamir <ratamir>
Severity: medium Docs Contact:
Priority: medium    
Version: 4.1.1.6CC: amureini, bugs, cmestreg, eshenitz, fabrice_moyen, hsahmed, michal.skrivanek, ratamir, shipatil, tnisan, ylavi
Target Milestone: ovirt-4.2.2Flags: ylavi: ovirt-4.2+
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-01-02 12:48:37 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Storage RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
engine.log
none
engine.log
none
new engine.log none

Description Carlos Mestre González 2017-03-29 12:25:45 UTC
Created attachment 1267296 [details]
engine.log

Description of problem:
Have a VM with VM Lease set, start it in run Once Mode, it fails to launch.

Version-Release number of selected component (if applicable):
4.1.1.6-0.1.el7

How reproducible:
100%

Steps to Reproduce:
1. Create a VM with boot disk (did it from cloning template)
2. Set the VM Lease to one of the storage
3. Try to start the vm with Run Once and specify a host to run with.

Actual results:
Error while executing action:

golden_env_mixed_virtio_1_0:

    There are no hosts to use. Check that the cluster contains at least one host in Up state.

Expected results:
VM runs


Additional info:
2017-03-29 15:11:49,723+03 INFO  [org.ovirt.engine.core.vdsbroker.UpdateVmDyna
micDataVDSCommand] (default task-13) [02518c04-1f12-4ec1-9dea-ee1a9f030d04] FI
NISH, UpdateVmDynamicDataVDSCommand, log id: 418122cc
2017-03-29 15:11:49,727+03 INFO  [org.ovirt.engine.core.vdsbroker.CreateVmVDSC
ommand] (default task-13) [02518c04-1f12-4ec1-9dea-ee1a9f030d04] START, Create
VmVDSCommand( CreateVmVDSCommandParameters:{runAsync='true', hostId='e2f392eb-
a9f4-44a5-9662-d521b9c58990', vmId='da26ff43-74c3-449c-b5ed-c8b0b6b13334', vm=
'VM [golden_env_mixed_virtio_1_0]'}), log id: 582b1475
2017-03-29 15:11:49,733+03 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.Cr
eateVDSCommand] (default task-13) [02518c04-1f12-4ec1-9dea-ee1a9f030d04] START
, CreateVDSCommand(HostName = host_mixed_2, CreateVmVDSCommandParameters:{runA
sync='true', hostId='e2f392eb-a9f4-44a5-9662-d521b9c58990', vmId='da26ff43-74c
3-449c-b5ed-c8b0b6b13334', vm='VM [golden_env_mixed_virtio_1_0]'}), log id: 4f
dc5f
2017-03-29 15:11:49,738+03 INFO  [org.ovirt.engine.core.vdsbroker.builder.vmin
fo.VmInfoBuilderImpl] (default task-13) [02518c04-1f12-4ec1-9dea-ee1a9f030d04]
 Bootable disk '8cade876-bbc7-4a86-8d89-77f3107ec293' set to index '0'
2017-03-29 15:11:49,746+03 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (default task-13) [02518c04-1f12-4ec1-9dea-ee1a9f030d04] Failed in 'CreateVDS' method, for vds: 'host_mixed_2'; host: 'storage-ge6-vdsm2.scl.lab.tlv.redhat.com': org.ovirt.engine.core.compat.Guid cannot be cast to java.lang.String
2017-03-29 15:11:49,746+03 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (default task-13) [02518c04-1f12-4ec1-9dea-ee1a9f030d04] Command 'CreateVDSCommand(HostName = host_mixed_2, CreateVmVDSCommandParameters:{runAsync='true', hostId='e2f392eb-a9f4-44a5-9662-d521b9c58990', vmId='da26ff43-74c3-449c-b5ed-c8b0b6b13334', vm='VM [golden_env_mixed_virtio_1_0]'})' execution failed: org.ovirt.engine.core.compat.Guid cannot be cast to java.lang.String
2017-03-29 15:11:49,746+03 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (default task-13) [02518c04-1f12-4ec1-9dea-ee1a9f030d04] Failed in 'CreateVDS' method, for vds: 'host_mixed_2'; host: 'storage-ge6-vdsm2.scl.lab.tlv.redhat.com': org.ovirt.engine.core.compat.Guid cannot be cast to java.lang.String
2017-03-29 15:11:49,746+03 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (default task-13) [02518c04-1f12-4ec1-9dea-ee1a9f030d04] Command 'CreateVDSCommand(HostName = host_mixed_2, CreateVmVDSCommandParameters:{runAsync='true', hostId='e2f392eb-a9f4-44a5-9662-d521b9c58990', vmId='da26ff43-74c3-449c-b5ed-c8b0b6b13334', vm='VM [golden_env_mixed_virtio_1_0]'})' execution failed: org.ovirt.engine.core.compat.Guid cannot be cast to java.lang.String
2017-03-29 15:11:49,746+03 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (default task-13) [02518c04-1f12-4ec1-9dea-ee1a9f030d04] FINISH, CreateVDSCommand, log id: 4fdc5f
2017-03-29 15:11:49,746+03 ERROR [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (default task-13) [02518c04-1f12-4ec1-9dea-ee1a9f030d04] Failed to create VM: org.ovirt.engine.core.compat.Guid cannot be cast to java.lang.String
2017-03-29 15:11:49,746+03 ERROR [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (default task-13) [02518c04-1f12-4ec1-9dea-ee1a9f030d04] Exception: java.lang.ClassCastException: org.ovirt.engine.core.compat.Guid cannot be cast to java.lang.String
        at org.ovirt.engine.core.vdsbroker.builder.vminfo.VmInfoBuilderImpl.buildVmBootSequence(VmInfoBuilderImpl.java:519) [vdsbroker.jar:]
        at org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand.buildVmData(CreateVDSCommand.java:53) [vdsbroker.jar:]
        at org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand.executeVdsBrokerCommand(CreateVDSCommand.java:31) [vdsbroker.jar:]
        at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:111) [vdsbroker.jar:]
        at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:73) [vdsbroker.jar:]
        at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:33) [dal.jar:]
        at org.ovirt.engine.core.vdsbroker.vdsbroker.DefaultVdsCommandExecutor.execute(DefaultVdsCommandExecutor.java:14) [vdsbroker.jar:]
        at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(Resou        at org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand.executeVmCommand(CreateVmVDSCommand.java:42) [vdsbroker.jar:]
        at org.ovirt.engine.core.vdsbroker.ManagingVmCommand.executeVDSCommand(ManagingVmCommand.java:17) [vdsbroker.jar:]
        at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:73) [vdsbroker.jar:]
        at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:33) [dal.jar:]
        at org.ovirt.engine.core.vdsbroker.vdsbroker.DefaultVdsCommandExecutor.execute(DefaultVdsCommandExecutor.java:14) [vdsbroker.jar:]
        at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:407) [vdsbroker.jar:]
        at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.runVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:]
        at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.runAsyncVdsCommand(VDSBrokerFrontendImpl.java:39) [bll.jar:]
        at org.ovirt.engine.core.bll.RunVmCommand.createVm(RunVmCommand.java:550) [bll.jar:]
        at org.ovirt.engine.core.bll.RunVmCommand.runVm(RunVmCommand.java:237) [bll.jar:]
        at org.ovirt.engine.core.bll.RunVmCommand.perform(RunVmCommand.java:401) [bll.jar:]
        at org.ovirt.engine.core.bll.RunVmCommand.executeVmCommand(RunVmCommand.java:326) [bll.jar:]
        at org.ovirt.engine.core.bll.VmCommand.executeCommand(VmCommand.java:120) [bll.jar:]
        at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1251) [bll.jar:]
        at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1391) [bll.jar:]
        at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:2055) [bll.jar:]
        at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164) [utils.jar:]
        at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103) [utils.jar:]
        at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1451) [bll.jar:]
        at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:397) [bll.jar:]
        at org.ovirt.engine.core.bll.RunVmCommandBase.reexecuteCommand(RunVmCommandBase.java:163) [bll.jar:]
        at org.ovirt.engine.core.bll.RunVmCommandBase.rerun(RunVmCommandBase.java:138) [bll.jar:]
        at org.ovirt.engine.core.bll.RunVmCommand.rerun(RunVmCommand.java:333) [bll.jar:]
        at org.ovirt.engine.core.bll.RunVmCommand.runVm(RunVmCommand.java:274) [bll.jar:]
        at org.ovirt.engine.core.bll.RunVmCommand.perform(RunVmCommand.java:401) [bll.jar:]
        at org.ovirt.engine.core.bll.RunVmCommand.executeVmCommand(RunVmCommand.java:326) [bll.jar:]
        at org.ovirt.engine.core.bll.VmCommand.executeCommand(VmCommand.java:120) [bll.jar:]
        at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:[...]

       at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecut
or.java:617) [rt.jar:1.8.0_121]
        at java.lang.Thread.run(Thread.java:745) [rt.jar:1.8.0_121]

2017-03-29 15:11:49,763+03 ERROR [org.ovirt.engine.core.vdsbroker.CreateVmVDSC
ommand] (default task-13) [02518c04-1f12-4ec1-9dea-ee1a9f030d04] Command 'Crea
teVmVDSCommand( CreateVmVDSCommandParameters:{runAsync='true', hostId='e2f392e
b-a9f4-44a5-9662-d521b9c58990', vmId='da26ff43-74c3-449c-b5ed-c8b0b6b13334', v
m='VM [golden_env_mixed_virtio_1_0]'})' execution failed: java.lang.ClassCastE
xception: org.ovirt.engine.core.compat.Guid cannot be cast to java.lang.String
2017-03-29 15:11:49,764+03 INFO  [org.ovirt.engine.core.vdsbroker.CreateVmVDSC
ommand] (default task-13) [02518c04-1f12-4ec1-9dea-ee1a9f030d04] FINISH, Creat
eVmVDSCommand, log id: 582b1475
2017-03-29 15:11:49,764+03 WARN  [org.ovirt.engine.core.bll.RunVmCommand] (default task-13) [02518c04-1f12-4ec1-9dea-ee1a9f030d04] Failed to run VM 'golden_env_mixed_virtio_1_0': EngineException: java.lang.RuntimeException: java.lang.ClassCastException: org.ovirt.engine.core.compat.Guid cannot be cast to java.lang.String (Failed with error ENGINE and code 5001)
2017-03-29 15:11:49,764+03 INFO  [org.ovirt.engine.core.bll.RunVmOnceCommand] (default task-13) [02518c04-1f12-4ec1-9dea-ee1a9f030d04] Lock freed to object 'EngineLock:{exclusiveLocks='[da26ff43-74c3-449c-b5ed-c8b0b6b13334=<VM, ACTION_TYPE_FAILED_OBJECT_LOCKED>]', sharedLocks='null'}'
2017-03-29 15:11:49,764+03 INFO  [org.ovirt.engine.core.bll.RunVmCommand] (default task-13) [02518c04-1f12-4ec1-9dea-ee1a9f030d04] Trying to rerun VM 'golden_env_mixed_virtio_1_0'
2017-03-29 15:11:49,777+03 WARN  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-13) [02518c04-1f12-4ec1-9dea-ee1a9f030d04] EVENT_ID: USER_INITIATED_RUN_VM_FAILED(151), Correlation ID: 02518c04-1f12-4ec1-9dea-ee1a9f030d04, Job ID: 196d0046-02e6-4d10-9cea-9f4ceebf8b36, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM golden_env_mixed_virtio_1_0 on Host host_mixed_2.

Comment 1 Michal Skrivanek 2017-03-30 05:05:09 UTC
the attachment doesn't contain the highlighted error

Comment 2 Carlos Mestre González 2017-03-31 08:38:40 UTC
Created attachment 1267771 [details]
engine.log

Comment 3 Allon Mureinik 2017-04-09 15:55:46 UTC
VM leases are for HA. Combining this with Run Once, while it should work, isn't a very interesting scenario.
Targeting for 4.1.3

Comment 4 Tal Nisan 2017-05-16 12:00:51 UTC
Carlos, I've been trying to reproduce a few times but couldn't, can you please check again on 4.1.2?

Comment 5 Carlos Mestre González 2017-05-17 11:29:31 UTC
Tal, I tried again in last 4.1.2.2-0.1 and occurs always... can I provide you with more logs or other? I see the same errors than in my first comment.

Comment 6 Tal Nisan 2017-05-17 13:14:36 UTC
Yeah, please add the new ones as well, trimmed from the point of trying to run the VM if possbile

Comment 7 Carlos Mestre González 2017-06-01 10:33:52 UTC
Created attachment 1284112 [details]
new engine.log

from version: 4.1.3-0.1.el7

Comment 8 Hesham 2017-08-02 14:09:23 UTC
I am facing the same error. Whenever trying to run a VM with HA and Lease enabled, runonce fails. Disable HA and it works. The same error is generated in the log files as OP although I am running ovirt-engine 4.1.3.5-1.el7

Comment 11 Eyal Shenitzky 2017-12-19 06:34:49 UTC
Sorry, Please ignore the above comment,

I didn't manage to reproduce the bug in 4.2.1_master and also on - 4.1.8.3_master.

Raz, can you please check if the bug reproduces and add the relevant scenario?

Comment 12 Raz Tamir 2017-12-19 08:30:36 UTC
(In reply to Eyal Shenitzky from comment #11)
> Sorry, Please ignore the above comment,
> 
> I didn't manage to reproduce the bug in 4.2.1_master and also on -
> 4.1.8.3_master.
> 
> Raz, can you please check if the bug reproduces and add the relevant
> scenario?

Issue reproduced with the provided steps to reproduce on rhevm-4.1.8.2-0.1

Comment 13 Allon Mureinik 2018-01-02 12:48:37 UTC

*** This bug has been marked as a duplicate of bug 1524347 ***