Created attachment 1678419 [details]
Logs

Description of problem:
I've seen the same errors as in bug 1820182 but with iSCSI and FC with LSM flows on the latest build:
ovirt-engine-4.4.0-0.32.master.el8ev.noarch
vdsm-4.40.13-1.el8ev.x86_64

When trying manually, the first attempt fails and the second attempt is working fine.

Engine:
2020-04-10 09:39:35,931+03 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MeasureVolumeVDSCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-92) [disks_syncAction_a462dd75-f602-4315] Failed in 'MeasureVolumeVDS' method
2020-04-10 09:39:35,936+03 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-92) [disks_syncAction_a462dd75-f602-4315] EVENT_ID: VDS_BROKER_COMMAND_FAILURE(10,802), VDSM host_mixed_1 command MeasureVolumeVDS failed: Command ['/usr/bin/qemu-img', 'measure', '--output', 'json', '-f', 'qcow2', '-O', 'qcow2', '/rhev/data-center/mnt/blockSD/69bdd640-605b-4987-9aac-7e389576f3dc/images/c2767b0f-f37a-4c33-9a70-162db91867da/3b3f36e3-8092-40dc-a4a8-35a27ee98c45'] failed with rc=1 out=b'' err=b"qemu-img: Could not open '/rhev/data-center/mnt/blockSD/69bdd640-605b-4987-9aac-7e389576f3dc/images/c2767b0f-f37a-4c33-9a70-162db91867da/3b3f36e3-8092-40dc-a4a8-35a27ee98c45': Could not open '/rhev/data-center/mnt/blockSD/69bdd640-605b-4987-9aac-7e389576f3dc/images/c2767b0f-f37a-4c33-9a70-162db91867da/3b3f36e3-8092-40dc-a4a8-35a27ee98c45': No such file or directory\n"
2020-04-10 09:39:35,936+03 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MeasureVolumeVDSCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-92) [disks_syncAction_a462dd75-f602-4315] Command 'MeasureVolumeVDSCommand(HostName = host_mixed_1, MeasureVolumeVDSCommandParameters:{hostId='4910e09a-2a21-47cb-a3b0-d2e96de40fd4', storagePoolId='ce534d57-c1e2-4b84-bd59-405c56f30160', storageDomainId='69bdd640-605b-4987-9aac-7e389576f3dc', imageGroupId='c2767b0f-f37a-4c33-9a70-162db91867da', imageId='3b3f36e3-8092-40dc-a4a8-35a27ee98c45'})' execution failed: VDSGenericException: VDSErrorException: Failed to MeasureVolumeVDS, error = Command ['/usr/bin/qemu-img', 'measure', '--output', 'json', '-f', 'qcow2', '-O', 'qcow2', '/rhev/data-center/mnt/blockSD/69bdd640-605b-4987-9aac-7e389576f3dc/images/c2767b0f-f37a-4c33-9a70-162db91867da/3b3f36e3-8092-40dc-a4a8-35a27ee98c45'] failed with rc=1 out=b'' err=b"qemu-img: Could not open '/rhev/data-center/mnt/blockSD/69bdd640-605b-4987-9aac-7e389576f3dc/images/c2767b0f-f37a-4c33-9a70-162db91867da/3b3f36e3-8092-40dc-a4a8-35a27ee98c45': Could not open '/rhev/data-center/mnt/blockSD/69bdd640-605b-4987-9aac-7e389576f3dc/images/c2767b0f-f37a-4c33-9a70-162db91867da/3b3f36e3-8092-40dc-a4a8-35a27ee98c45': No such file or directory\n", code = 100
2020-04-10 09:39:35,936+03 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.MeasureVolumeVDSCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-92) [disks_syncAction_a462dd75-f602-4315] FINISH, MeasureVolumeVDSCommand, return: , log id: 76a07dd2
2020-04-10 09:39:35,936+03 ERROR [org.ovirt.engine.core.bll.storage.disk.image.MeasureVolumeCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-92) [disks_syncAction_a462dd75-f602-4315] Command 'org.ovirt.engine.core.bll.storage.disk.image.MeasureVolumeCommand' failed: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to MeasureVolumeVDS, error = Command ['/usr/bin/qemu-img', 'measure', '--output', 'json', '-f', 'qcow2', '-O', 'qcow2', '/rhev/data-center/mnt/blockSD/69bdd640-605b-4987-9aac-7e389576f3dc/images/c2767b0f-f37a-4c33-9a70-162db91867da/3b3f36e3-8092-40dc-a4a8-35a27ee98c45'] failed with rc=1 out=b'' err=b"qemu-img: Could not open '/rhev/data-center/mnt/blockSD/69bdd640-605b-4987-9aac-7e389576f3dc/images/c2767b0f-f37a-4c33-9a70-162db91867da/3b3f36e3-8092-40dc-a4a8-35a27ee98c45': Could not open '/rhev/data-center/mnt/blockSD/69bdd640-605b-4987-9aac-7e389576f3dc/images/c2767b0f-f37a-4c33-9a70-162db91867da/3b3f36e3-8092-40dc-a4a8-35a27ee98c45': No such file or directory\n", code = 100 (Failed with error GeneralException and code 100)
2020-04-10 09:39:35,942+03 ERROR [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-92) [disks_syncAction_a462dd75-f602-4315] Command 'CloneImageGroupVolumesStructure' id: 'b3e23002-9ffb-4ef2-be22-44b31fbc7a54' with children [] failed when attempting to perform the next operation, marking as 'ACTIVE'
2020-04-10 09:39:35,942+03 ERROR [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-92) [disks_syncAction_a462dd75-f602-4315] Could not measure volume: java.lang.RuntimeException: Could not measure volume
	at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.storage.disk.image.CloneImageGroupVolumesStructureCommand.determineImageInitialSize(CloneImageGroupVolumesStructureCommand.java:214)
	at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.storage.disk.image.CloneImageGroupVolumesStructureCommand.createImage(CloneImageGroupVolumesStructureCommand.java:163)
	at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.storage.disk.image.CloneImageGroupVolumesStructureCommand.performNextOperation(CloneImageGroupVolumesStructureCommand.java:133)
	at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback.childCommandsExecutionEnded(SerialChildCommandsExecutionCallback.java:32)
	at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.ChildCommandsCallbackBase.doPolling(ChildCommandsCallbackBase.java:80)
	at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller.invokeCallbackMethodsImpl(CommandCallbacksPoller.java:175)
	at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller.invokeCallbackMethods(CommandCallbacksPoller.java:109)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
	at org.glassfish.javax.enterprise.concurrent.0.redhat-1//org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$201(ManagedScheduledThreadPoolExecutor.java:383)
	at org.glassfish.javax.enterprise.concurrent.0.redhat-1//org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:534)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:834)
	at org.glassfish.javax.enterprise.concurrent.0.redhat-1//org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250)

VDSM:
2020-04-10 09:39:35,920+0300 INFO  (jsonrpc/3) [vdsm.api] FINISH measure error=Command ['/usr/bin/qemu-img', 'measure', '--output', 'json', '-f', 'qcow2', '-O', 'qcow2', '/rhev/data-center/mnt/blockSD/69bdd640-605b-4987-9aac-7e389576f3dc/images/c2767b0f-f37a-4c33-9a70-162db91867da/3b3f36e3-8092-40dc-a4a8-35a27ee98c45'] failed with rc=1 out=b'' err=b"qemu-img: Could not open '/rhev/data-center/mnt/blockSD/69bdd640-605b-4987-9aac-7e389576f3dc/images/c2767b0f-f37a-4c33-9a70-162db91867da/3b3f36e3-8092-40dc-a4a8-35a27ee98c45': Could not open '/rhev/data-center/mnt/blockSD/69bdd640-605b-4987-9aac-7e389576f3dc/images/c2767b0f-f37a-4c33-9a70-162db91867da/3b3f36e3-8092-40dc-a4a8-35a27ee98c45': No such file or directory\n" from=::ffff:10.46.16.131,36538, flow_id=disks_syncAction_a462dd75-f602-4315, task_id=00882e57-aed1-448a-a151-c41f1d612e92 (api:52)
2020-04-10 09:39:35,921+0300 ERROR (jsonrpc/3) [storage.TaskManager.Task] (Task='00882e57-aed1-448a-a151-c41f1d612e92') Unexpected error (task:880)
Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/vdsm/storage/task.py", line 887, in _run
    return fn(*args, **kargs)
  File "<decorator-gen-161>", line 2, in measure
  File "/usr/lib/python3.6/site-packages/vdsm/common/api.py", line 50, in method
    ret = func(*args, **kwargs)
  File "/usr/lib/python3.6/site-packages/vdsm/storage/hsm.py", line 3155, in measure
    output_format=sc.fmt2str(dest_format)
  File "/usr/lib/python3.6/site-packages/vdsm/storage/qemuimg.py", line 160, in measure
    out = _run_cmd(cmd)
  File "/usr/lib/python3.6/site-packages/vdsm/storage/qemuimg.py", line 481, in _run_cmd
    raise cmdutils.Error(cmd, rc, out, err)
vdsm.common.cmdutils.Error: Command ['/usr/bin/qemu-img', 'measure', '--output', 'json', '-f', 'qcow2', '-O', 'qcow2', '/rhev/data-center/mnt/blockSD/69bdd640-605b-4987-9aac-7e389576f3dc/images/c2767b0f-f37a-4c33-9a70-162db91867da/3b3f36e3-8092-40dc-a4a8-35a27ee98c45'] failed with rc=1 out=b'' err=b"qemu-img: Could not open '/rhev/data-center/mnt/blockSD/69bdd640-605b-4987-9aac-7e389576f3dc/images/c2767b0f-f37a-4c33-9a70-162db91867da/3b3f36e3-8092-40dc-a4a8-35a27ee98c45': Could not open '/rhev/data-center/mnt/blockSD/69bdd640-605b-4987-9aac-7e389576f3dc/images/c2767b0f-f37a-4c33-9a70-162db91867da/3b3f36e3-8092-40dc-a4a8-35a27ee98c45': No such file or directory\n"

Attaching relevant logs.

Version-Release number of selected component (if applicable):
ovirt-engine-4.4.0-0.32.master.el8ev.noarch
vdsm-4.40.13-1.el8ev.x86_64

How reproducible:
Always

Steps to Reproduce:
1. create blank vm
2. create 10g thin disk on ISCSI and attach it to the vm
3. start the vm
4. migrate to disk to other iscsi domain

Actual results:
Operation fails

Expected results:
Operation should succeed

Additional info:
Logs are attached