Bug 1575289 - Snapshot creation, as part of live storage migration, fails on getQemuImageInfo
Summary: Snapshot creation, as part of live storage migration, fails on getQemuImageInfo
Keywords:
Status: CLOSED INSUFFICIENT_DATA
Alias: None
Product: vdsm
Classification: oVirt
Component: Core
Version: 4.20.23
Hardware: x86_64
OS: Unspecified
unspecified
high
Target Milestone: ovirt-4.2.4
: ---
Assignee: Benny Zlotnik
QA Contact: Elad
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2018-05-05 18:15 UTC by Elad
Modified: 2018-05-30 09:56 UTC (History)
2 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2018-05-30 09:56:30 UTC
oVirt Team: Storage
rule-engine: ovirt-4.2+


Attachments (Terms of Use)
logs (2.95 MB, application/x-gzip)
2018-05-05 18:15 UTC, Elad
no flags Details

Description Elad 2018-05-05 18:15:51 UTC
Created attachment 1432011 [details]
logs

Description of problem:
Live snapshot fails on getQemuImageInfo

Version-Release number of selected component (if applicable):
rhvm-4.2.3.3-0.1.el7.noarch
vdsm-4.20.27-1.el7ev.x86_64
libvirt-3.9.0-14.el7_5.3.x86_64
qemu-kvm-rhev-2.10.0-21.el7_5.2.x86_64


How reproducible:
1/1

Steps to Reproduce:
1. Create VM from template as thin copy on iSCSI
2. Start the VM
3. Create and attach a disk, resides on iSCSI domain, to the VM
4. Create a snapsot to the VM with all disks and memory
5. Live migrate all VM disks

Actual results:


2018-05-05 19:56:05,203+0300 INFO  (jsonrpc/4) [vdsm.api] FINISH getQemuImageInfo error=Command ['/usr/bin/qemu-img', 'info', '--output', 'json', '-f', 'qcow2', '-U', '/rhev/data-center/mnt/blockSD/6b4f9eb5-6740
-4ffc-8e94-34354f757632/images/3a8110bc-6a29-4811-95b7-7defb6021f8c/af67e46b-69d8-4af2-b0de-dba742a79957'] failed with rc=1 out='' err="qemu-img: Could not open '/rhev/data-center/mnt/blockSD/6b4f9eb5-6740-4ffc-
8e94-34354f757632/images/3a8110bc-6a29-4811-95b7-7defb6021f8c/af67e46b-69d8-4af2-b0de-dba742a79957': Could not open '/rhev/data-center/mnt/blockSD/6b4f9eb5-6740-4ffc-8e94-34354f757632/images/3a8110bc-6a29-4811-9
5b7-7defb6021f8c/af67e46b-69d8-4af2-b0de-dba742a79957': No such file or directory\n" from=::ffff:10.35.162.10,51746, flow_id=disks_syncAction_c72848c2-632a-4022, task_id=d3499287-7dc4-4a09-acf0-e0afee2a3010 (api
:50)
2018-05-05 19:56:05,205+0300 ERROR (jsonrpc/4) [storage.TaskManager.Task] (Task='d3499287-7dc4-4a09-acf0-e0afee2a3010') Unexpected error (task:875)
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 882, in _run
    return fn(*args, **kargs)
  File "<string>", line 2, in getQemuImageInfo
  File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 48, in method
    ret = func(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/hsm.py", line 3101, in getQemuImageInfo
    info = vol.getQemuImageInfo()
  File "/usr/lib/python2.7/site-packages/vdsm/storage/volume.py", line 1483, in getQemuImageInfo
    return self._manifest.getQemuImageInfo()
  File "/usr/lib/python2.7/site-packages/vdsm/storage/volume.py", line 290, in getQemuImageInfo
    unsafe=True)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/qemuimg.py", line 91, in info
    out = _run_cmd(cmd)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/qemuimg.py", line 409, in _run_cmd
    raise cmdutils.Error(cmd, rc, out, err)
Error: Command ['/usr/bin/qemu-img', 'info', '--output', 'json', '-f', 'qcow2', '-U', '/rhev/data-center/mnt/blockSD/6b4f9eb5-6740-4ffc-8e94-34354f757632/images/3a8110bc-6a29-4811-95b7-7defb6021f8c/af67e46b-69d8-4af2-b0de-dba742a79957'] failed with rc=1 out='' err="qemu-img: Could not open '/rhev/data-center/mnt/blockSD/6b4f9eb5-6740-4ffc-8e94-34354f757632/images/3a8110bc-6a29-4811-95b7-7defb6021f8c/af67e46b-69d8-4af2-b0de-dba742a79957': Could not open '/rhev/data-center/mnt/blockSD/6b4f9eb5-6740-4ffc-8e94-34354f757632/images/3a8110bc-6a29-4811-95b7-7defb6021f8c/af67e46b-69d8-4af2-b0de-dba742a79957': No such file or directory\n"




Expected results:
Live snapshot, as part of live storage migration, should succeed

Additional info:
engine.log:


2018-05-05 19:56:05,245+03 ERROR [org.ovirt.engine.core.bll.storage.disk.image.ImagesHandler] (EE-ManagedThreadFactory-engineScheduled-Thread-92) [disks_syncAction_c72848c2-632a-4022] Unable to get qemu image info from storage: org.ovirt.engine.core.common.errors.EngineException: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to GetQemuImageInfoVDS, error = Command ['/usr/bin/qemu-img', 'info', '--output', 'json', '-f', 'qcow2', '-U', '/rhev/data-center/mnt/blockSD/6b4f9eb5-6740-4ffc-8e94-34354f757632/images/3a8110bc-6a29-4811-95b7-7defb6021f8c/af67e46b-69d8-4af2-b0de-dba742a79957'] failed with rc=1 out='' err="qemu-img: Could not open '/rhev/data-center/mnt/blockSD/6b4f9eb5-6740-4ffc-8e94-34354f757632/images/3a8110bc-6a29-4811-95b7-7defb6021f8c/af67e46b-69d8-4af2-b0de-dba742a79957': Could not open '/rhev/data-center/mnt/blockSD/6b4f9eb5-6740-4ffc-8e94-34354f757632/images/3a8110bc-6a29-4811-95b7-7defb6021f8c/af67e46b-69d8-4af2-b0de-dba742a79957': No such file or directory\n", code = 100 (Failed with error GeneralException and code 100)
        at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:118) [bll.jar:]
        at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.runVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:]
        at org.ovirt.engine.core.bll.storage.disk.image.ImagesHandler.getQemuImageInfoFromVdsm(ImagesHandler.java:833) [bll.jar:]
        at org.ovirt.engine.core.bll.storage.disk.image.BaseImagesCommand.setQcowCompat(BaseImagesCommand.java:452) [bll.jar:]
        at org.ovirt.engine.core.bll.storage.disk.image.BaseImagesCommand.setQcowCompatByQemuImageInfo(BaseImagesCommand.java:436) [bll.jar:]
        at org.ovirt.engine.core.bll.storage.disk.image.BaseImagesCommand.endSuccessfully(BaseImagesCommand.java:394) [bll.jar:]
        at org.ovirt.engine.core.bll.CommandBase.internalEndSuccessfully(CommandBase.java:675) [bll.jar:]
        at org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:630) [bll.jar:]
        at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1936) [bll.jar:]


Note You need to log in before you can comment on or make changes to this bug.