1625669 – Copy disk fails with MetaDataValidationError every time for a specific disk

Bug 1625669 - Copy disk fails with MetaDataValidationError every time for a specific disk

Summary: Copy disk fails with MetaDataValidationError every time for a specific disk

Keywords:
Status:	CLOSED DUPLICATE of bug 1625240
Alias:	None
Product:	vdsm
Classification:	oVirt
Component:	Core
Sub Component:
Version:	4.20.31
Hardware:	x86_64
OS:	Unspecified
Priority:	unspecified
Severity:	high
Target Milestone:	---
Target Release:	---
Assignee:	Dan Kenigsberg
QA Contact:	Elad
Docs Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+	depends on / blocked

Reported:	2018-09-05 13:32 UTC by Elad
Modified:	2018-09-16 12:32 UTC (History)
CC List:	3 users (show)
Fixed In Version:
Clone Of:
Environment:
Last Closed:	2018-09-16 12:32:54 UTC
oVirt Team:	Storage
Embargoed:
Dependent Products:

Attachments	(Terms of Use)

Description Elad 2018-09-05 13:32:12 UTC

Description of problem:
Copy disk fails with MetaDataValidationError on vdsm


Version-Release number of selected component (if applicable):

[root@vega13 ~]# rpm -qa |grep ovirt                                                                                                                                                                                                         
ovirt-imageio-common-1.4.4-0.el7ev.x86_64
ovirt-vmconsole-host-1.0.5-4.el7ev.noarch
ovirt-vmconsole-1.0.5-4.el7ev.noarch
ovirt-imageio-daemon-1.4.4-0.el7ev.noarch
[root@vega13 ~]# rpm -qa |grep vdsm
vdsm-api-4.20.39-1.el7ev.noarch
vdsm-client-4.20.39-1.el7ev.noarch
vdsm-jsonrpc-4.20.39-1.el7ev.noarch
vdsm-yajsonrpc-4.20.39-1.el7ev.noarch
vdsm-python-4.20.39-1.el7ev.noarch
vdsm-4.20.39-1.el7ev.x86_64
vdsm-common-4.20.39-1.el7ev.noarch
vdsm-network-4.20.39-1.el7ev.x86_64
vdsm-hook-vmfex-dev-4.20.39-1.el7ev.noarch
vdsm-http-4.20.39-1.el7ev.noarch
[root@vega13 ~]# rpm -qa |grep libvirt
libvirt-daemon-driver-storage-gluster-3.9.0-14.el7_5.7.x86_64
libvirt-daemon-driver-storage-3.9.0-14.el7_5.7.x86_64
libvirt-daemon-driver-nwfilter-3.9.0-14.el7_5.7.x86_64
libvirt-daemon-driver-storage-logical-3.9.0-14.el7_5.7.x86_64
libvirt-lock-sanlock-3.9.0-14.el7_5.7.x86_64
libvirt-daemon-driver-network-3.9.0-14.el7_5.7.x86_64
libvirt-client-3.9.0-14.el7_5.7.x86_64
libvirt-daemon-driver-storage-core-3.9.0-14.el7_5.7.x86_64
libvirt-daemon-driver-storage-scsi-3.9.0-14.el7_5.7.x86_64
libvirt-daemon-driver-storage-iscsi-3.9.0-14.el7_5.7.x86_64
libvirt-daemon-config-nwfilter-3.9.0-14.el7_5.7.x86_64
libvirt-daemon-driver-nodedev-3.9.0-14.el7_5.7.x86_64
libvirt-daemon-3.9.0-14.el7_5.7.x86_64
libvirt-python-3.9.0-1.el7.x86_64
libvirt-daemon-driver-qemu-3.9.0-14.el7_5.7.x86_64
libvirt-daemon-driver-storage-disk-3.9.0-14.el7_5.7.x86_64
libvirt-daemon-driver-secret-3.9.0-14.el7_5.7.x86_64
libvirt-libs-3.9.0-14.el7_5.7.x86_64
libvirt-daemon-driver-storage-rbd-3.9.0-14.el7_5.7.x86_64
libvirt-daemon-driver-interface-3.9.0-14.el7_5.7.x86_64
libvirt-daemon-driver-storage-mpath-3.9.0-14.el7_5.7.x86_64
libvirt-daemon-kvm-3.9.0-14.el7_5.7.x86_64
[root@vega13 ~]# rpm -qa |grep sanlock
libvirt-lock-sanlock-3.9.0-14.el7_5.7.x86_64
sanlock-3.6.0-1.el7.x86_64
sanlock-python-3.6.0-1.el7.x86_64
sanlock-lib-3.6.0-1.el7.x86_64
[root@vega13 ~]# rpm -qa |grep selinux
libselinux-ruby-2.5-12.el7.x86_64
libselinux-2.5-12.el7.x86_64
libselinux-utils-2.5-12.el7.x86_64
selinux-policy-targeted-3.13.1-192.el7_5.6.noarch
selinux-policy-3.13.1-192.el7_5.6.noarch
libselinux-python-2.5-12.el7.x86_64
libselinux-2.5-12.el7.i686
[root@vega13 ~]# rpm -qa |grep qemu
ipxe-roms-qemu-20170123-1.git4e85b27.el7_4.1.noarch
qemu-kvm-rhev-2.10.0-21.el7_5.7.x86_64
qemu-img-rhev-2.10.0-21.el7_5.7.x86_64
libvirt-daemon-driver-qemu-3.9.0-14.el7_5.7.x86_64
qemu-kvm-common-rhev-2.10.0-21.el7_5.7.x86_64
qemu-kvm-tools-rhev-2.10.0-21.el7_5.7.x86_64
[root@vega13 ~]# uname -a 
Linux vega13.qa.lab.tlv.redhat.com 3.10.0-862.11.6.el7.x86_64 #1 SMP Fri Aug 10 16:55:11 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
[root@vega13 ~]# cat /etc/os-release
NAME="Red Hat Enterprise Linux Server"
VERSION="7.5 (Maipo)"

rhv-4.2.6

How reproducible:
Always for a specific disk


Steps to Reproduce:
1. Copy disk while the VM is down


Actual results:


2018-09-05 15:25:51,439+0300 INFO  (tasks/9) [storage.ThreadPool.WorkerThread] START task af2c4073-e552-425a-be86-db19a0c50a27 (cmd=<bound method Task.commit of <vdsm.storage.task.Task instance at 0x7f31085b0ef0>>, args=None) (threadPool:208)
2018-09-05 15:25:51,571+0300 INFO  (tasks/9) [storage.Image] sdUUID=517268b4-e6b5-4890-8266-b0a53932a3b3 vmUUID= srcImgUUID=b20deb5a-b087-4281-8891-2b3252cb96f4 srcVolUUID=a2ba792b-23ff-4373-84b7-85fd5a1af047 dstImgUUID=fa24c26c-f721-42d1-a4a5-2432f896ddc9 dstVolUUID=cde75cc1-0a08-43c1-bd9f-4c27cc9b0976 dstSdUUID=037837c4-44ea-4780-89ca-e6c7561d758d volType=8 volFormat=COW preallocate=SPARSE force=False postZero=False discard=True (image:720)
2018-09-05 15:25:51,601+0300 ERROR (tasks/9) [storage.Image] Unexpected error (image:797)
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/vdsm/storage/image.py", line 743, in copyCollapsed
    volParams = srcVol.getVolumeParams()
  File "/usr/lib/python2.7/site-packages/vdsm/storage/volume.py", line 1515, in getVolumeParams
    return self._manifest.getVolumeParams(bs)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/volume.py", line 306, in getVolumeParams
    volParams['size'] = self.getSize()
  File "/usr/lib/python2.7/site-packages/vdsm/storage/volume.py", line 177, in getSize
    raise se.MetaDataValidationError()
MetaDataValidationError: Meta Data self-validation failed: ()
2018-09-05 15:25:51,601+0300 INFO  (tasks/9) [storage.VolumeManifest] Tearing down volume 517268b4-e6b5-4890-8266-b0a53932a3b3/a2ba792b-23ff-4373-84b7-85fd5a1af047 justme False (blockVolume:387)
2018-09-05 15:25:51,602+0300 ERROR (tasks/9) [storage.Image] Unexpected error (image:688)
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/vdsm/storage/image.py", line 684, in __cleanupCopy
    srcVol.teardown(sdUUID=srcVol.sdUUID, volUUID=srcVol.volUUID)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/volume.py", line 1460, in teardown
    return cls.manifestClass.teardown(sdUUID, volUUID, justme)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/blockVolume.py", line 390, in teardown
    rm.releaseResource(lvmActivationNamespace, volUUID)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/resourceManager.py", line 1029, in releaseResource
    _manager.releaseResource(namespace, name)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/resourceManager.py", line 581, in releaseResource
    "registered" % (namespace, name))
ValueError: Resource '03_lvm_517268b4-e6b5-4890-8266-b0a53932a3b3.a2ba792b-23ff-4373-84b7-85fd5a1af047' is not currently registered
2018-09-05 15:25:51,602+0300 ERROR (tasks/9) [storage.TaskManager.Task] (Task='af2c4073-e552-425a-be86-db19a0c50a27') Unexpected error (task:875)
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 882, in _run
    return fn(*args, **kargs)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 336, in run
    return self.cmd(*self.argslist, **self.argsdict)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/securable.py", line 79, in wrapper
    return method(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/sp.py", line 1623, in copyImage
    postZero, force, discard)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/image.py", line 743, in copyCollapsed
    volParams = srcVol.getVolumeParams()
  File "/usr/lib/python2.7/site-packages/vdsm/storage/volume.py", line 1515, in getVolumeParams
    return self._manifest.getVolumeParams(bs)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/volume.py", line 306, in getVolumeParams
    volParams['size'] = self.getSize()
  File "/usr/lib/python2.7/site-packages/vdsm/storage/volume.py", line 177, in getSize
    raise se.MetaDataValidationError()
MetaDataValidationError: Meta Data self-validation failed: ()


Expected results:
Copy disk should succeed

Additional info:
https://drive.google.com/file/d/1APJU33Dyq2gwZHjfbzsJD_u24h5nOdX4/view?usp=sharing

The environemt is running, please contact me for its details

Comment 1 Tal Nisan 2018-09-05 16:45:38 UTC

Benny, can you have a look please?

Comment 2 Benny Zlotnik 2018-09-16 08:03:00 UTC

Looks like the same issue as: https://bugzilla.redhat.com/show_bug.cgi?id=1625240

Comment 3 Tal Nisan 2018-09-16 12:32:54 UTC


*** This bug has been marked as a duplicate of bug 1625240 ***

Note You need to log in before you can comment on or make changes to this bug.