Bug 1507994

Created attachment 1346001 [details]
vdsm, server, engine logs

Added logs

The log is full of domain monitoring errors.

Does this happen on non HCI environments? On other HCI environments?

(In reply to Allon Mureinik from comment #2)
> The log is full of domain monitoring errors.
> 
> Does this happen on non HCI environments? On other HCI environments?



It works on regular environment

@Kevin,

Did you perform any disk move?
Following vdsm error shows that disk replication fails to start:

2017-10-31 17:20:33,898+0200 ERROR (jsonrpc/7) [virt.vm] (vmId='7330e919-62bc-4e3f-990b-111e2fcbf87d') Unable to start replication for sda to {u'domainID': u'01bdd2ad-f506-4e4d-b1c5-e037a163
0821', 'volumeInfo': {'path': u'glust1_rep3/01bdd2ad-f506-4e4d-b1c5-e037a1630821/images/db4120d3-da1c-4297-ab67-8c53c2bbe62f/2b886bc8-cece-470b-950a-0c3b8da5315f', 'protocol': 'gluster', 'ho
sts': [{'port': '0', 'transport': 'tcp', 'name': '10.35.83.240'}, {'port': '0', 'transport': 'tcp', 'name': '10.35.83.241'}, {'port': '0', 'transport': 'tcp', 'name': '10.35.83.242'}]}, 'for
mat': 'cow', u'poolID': u'96cc313a-67d4-49e8-8979-27d3fcfd171c', u'device': 'disk', 'protocol': 'gluster', 'propagateErrors': 'off', u'diskType': u'network', 'cache': 'none', u'volumeID': u'
2b886bc8-cece-470b-950a-0c3b8da5315f', u'imageID': u'db4120d3-da1c-4297-ab67-8c53c2bbe62f', 'hosts': [{'port': '0', 'transport': 'tcp', 'name': '10.35.83.240'}], 'path': u'glust1_rep3/01bdd2
ad-f506-4e4d-b1c5-e037a1630821/images/db4120d3-da1c-4297-ab67-8c53c2bbe62f/2b886bc8-cece-470b-950a-0c3b8da5315f', 'volumeChain': [{'domainID': u'01bdd2ad-f506-4e4d-b1c5-e037a1630821', 'lease
Offset': 0, 'path': u'glust1_rep3/01bdd2ad-f506-4e4d-b1c5-e037a1630821/images/db4120d3-da1c-4297-ab67-8c53c2bbe62f/4e01405c-80fd-40d4-b5aa-57ec08f23dc1', 'volumeID': u'4e01405c-80fd-40d4-b5a
a-57ec08f23dc1', 'leasePath': u'/rhev/data-center/mnt/glusterSD/10.35.83.240:_glust1__rep3/01bdd2ad-f506-4e4d-b1c5-e037a1630821/images/db4120d3-da1c-4297-ab67-8c53c2bbe62f/4e01405c-80fd-40d4
-b5aa-57ec08f23dc1.lease', 'imageID': u'db4120d3-da1c-4297-ab67-8c53c2bbe62f'}, {'domainID': u'01bdd2ad-f506-4e4d-b1c5-e037a1630821', 'leaseOffset': 0, 'path': u'glust1_rep3/01bdd2ad-f506-4e
4d-b1c5-e037a1630821/images/db4120d3-da1c-4297-ab67-8c53c2bbe62f/2b886bc8-cece-470b-950a-0c3b8da5315f', 'volumeID': u'2b886bc8-cece-470b-950a-0c3b8da5315f', 'leasePath': u'/rhev/data-center/
mnt/glusterSD/10.35.83.240:_glust1__rep3/01bdd2ad-f506-4e4d-b1c5-e037a1630821/images/db4120d3-da1c-4297-ab67-8c53c2bbe62f/2b886bc8-cece-470b-950a-0c3b8da5315f.lease', 'imageID': u'db4120d3-d
a1c-4297-ab67-8c53c2bbe62f'}, {'domainID': u'01bdd2ad-f506-4e4d-b1c5-e037a1630821', 'leaseOffset': 0, 'path': u'glust1_rep3/01bdd2ad-f506-4e4d-b1c5-e037a1630821/images/db4120d3-da1c-4297-ab6
7-8c53c2bbe62f/533d83bc-1473-4bc3-bb3f-41254eb786c0', 'volumeID': u'533d83bc-1473-4bc3-bb3f-41254eb786c0', 'leasePath': u'/rhev/data-center/mnt/glusterSD/10.35.83.240:_glust1__rep3/01bdd2ad-
f506-4e4d-b1c5-e037a1630821/images/db4120d3-da1c-4297-ab67-8c53c2bbe62f/533d83bc-1473-4bc3-bb3f-41254eb786c0.lease', 'imageID': u'db4120d3-da1c-4297-ab67-8c53c2bbe62f'}, {'domainID': u'01bdd
2ad-f506-4e4d-b1c5-e037a1630821', 'leaseOffset': 0, 'path': u'glust1_rep3/01bdd2ad-f506-4e4d-b1c5-e037a1630821/images/db4120d3-da1c-4297-ab67-8c53c2bbe62f/2b0b5b2f-a015-4593-9e59-e22667b9009
c', 'volumeID': u'2b0b5b2f-a015-4593-9e59-e22667b9009c', 'leasePath': u'/rhev/data-center/mnt/glusterSD/10.35.83.240:_glust1__rep3/01bdd2ad-f506-4e4d-b1c5-e037a1630821/images/db4120d3-da1c-4
297-ab67-8c53c2bbe62f/2b0b5b2f-a015-4593-9e59-e22667b9009c.lease', 'imageID': u'db4120d3-da1c-4297-ab67-8c53c2bbe62f'}, {'domainID': u'01bdd2ad-f506-4e4d-b1c5-e037a1630821', 'leaseOffset': 0
, 'path': u'glust1_rep3/01bdd2ad-f506-4e4d-b1c5-e037a1630821/images/db4120d3-da1c-4297-ab67-8c53c2bbe62f/d566b684-1499-4afc-b74d-405102591aee', 'volumeID': u'd566b684-1499-4afc-b74d-40510259
1aee', 'leasePath': u'/rhev/data-center/mnt/glusterSD/10.35.83.240:_glust1__rep3/01bdd2ad-f506-4e4d-b1c5-e037a1630821/images/db4120d3-da1c-4297-ab67-8c53c2bbe62f/d566b684-1499-4afc-b74d-4051
02591aee.lease', 'imageID': u'db4120d3-da1c-4297-ab67-8c53c2bbe62f'}]} (vm:4356)
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 4350, in diskReplicateStart
    self._startDriveReplication(drive)
  File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 4479, in _startDriveReplication
    self._dom.blockCopy(drive.name, destxml, flags=flags)
  File "/usr/lib/python2.7/site-packages/vdsm/virt/virdomain.py", line 98, in f
    ret = attr(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line 125, in wrapper
    ret = f(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 586, in wrapper
    return func(inst, *args, **kwargs)
  File "/usr/lib64/python2.7/site-packages/libvirt.py", line 688, in blockCopy
    if ret == -1: raise libvirtError ('virDomainBlockCopy() failed', dom=self)
libvirtError: argument unsupported: non-file destination not supported yet

(In reply to Ala Hino from comment #4)
> @Kevin,
> 
> Did you perform any disk move?
> Following vdsm error shows that disk replication fails to start:

This underlying issue was solved by Denis' 2c03d2307b8da5fb6fc6eac026ea554beefc2dc2 merged on October 30th (which was not available when this bug was reported)
Please retest with a newer engine build that contains the fix.

Verified with the following code:
----------------------------------------------
ovirt-engine-4.2.0-0.5.master.el7.noarch
vdsm-4.20.7-55.git11440d6.el7.centos.x86_64


Verified with the following scenario:
----------------------------------------------
Steps to Reproduce:
1. Create a vm with 2 disks, create snapshot
2. Start vm, write data, create 2nd snapshot
3. Write data, create 3rd snapshot
4. Via Webadmin->Storage Domains->Hyperconv Gluster domain->Disk Snapshots->select snapshot disk from 2nd snapshot and press Remove >>>>> The disk snapshot is successfully removed

This bugzilla is included in oVirt 4.2.0 release, published on Dec 20th 2017.

Since the problem described in this bug report should be
resolved in oVirt 4.2.0 release, published on Dec 20th 2017, it has been closed with a resolution of CURRENT RELEASE.

If the solution does not work for you, please open a new bug report.