Bug 1726168

Created attachment 1586604 [details]
v2v log

Possibly relevant stackoverflow:
https://stackoverflow.com/questions/34718208/catch-broken-pipe-in-python-2-and-python-3

Verify the bug with below builds:
virt-v2v-1.40.2-6.el7.x86_64
libguestfs-1.40.2-6.el7.x86_64
qemu-kvm-rhev-2.12.0-33.el7_7.1.x86_64
libvirt-4.5.0-23.el7.x86_64
nbdkit-1.8.0-1.el7.x86_64

Steps;
1.Convert a guest from VMware to rhv using rhv-upload on standalone v2v conversion server
#virt-v2v -ic vpx://root.73.141/data/10.73.75.219/?no_verify=1 esx6.7-rhel7.6-x86_64 --password-file /tmp/passwd -o rhv-upload -oc https://ibm-x3250m5-03.rhts.eng.pek2.redhat.com/ovirt-engine/api -os p2v_data -op /tmp/rhvpasswd -oo rhv-cafile=/home/ca.pem -oo rhv-direct=true -oo rhv-cluster=p2v


2.Waiting for the copying disk starts in above v2v conversion and check the ticket ID of this conversion in ovirt-imageio-daemon log on rhv-node 'p2v', then execute the command of steps2.2 constantly to make the ticket expired 

2.1 # cat /var/log/ovirt-imageio-daemon/daemon.log | grep ADD | tail -1
2019-08-16 14:28:37,149 INFO    (Thread-778) [tickets] [local] ADD ticket={u'uuid': u'3f7867e5-5c86-47bb-a44e-da754e9389f3', u'ops': [u'write'], u'url': u'file:///rhev/data-center/mnt/10.73.224.199:_home_p2v__data/6f298424-7d5b-4310-9eb4-f69871065298/images/d905fad7-bc33-441b-8885-8c8019a1f727/552794ba-c794-4903-97f4-92d41716928d', u'sparse': True, u'timeout': 300, u'transfer_id': u'48814401-03b7-416e-8f94-dcca8ca5c8f5', u'size': 17179869184}

2.2 #  curl --unix-socket /run/vdsm/ovirt-imageio-daemon.sock -X PATCH -d '{"timeout": 1}' http://localhost/tickets/3f7867e5-5c86-47bb-a44e-da754e9389f3


3.Found the v2v conversion of step1 is failed with below error which is expected result 
# virt-v2v -ic vpx://root.73.141/data/10.73.75.219/?no_verify=1 esx6.7-rhel7.6-x86_64 --password-file /tmp/passwd -o rhv-upload -oc https://ibm-x3250m5-03.rhts.eng.pek2.redhat.com/ovirt-engine/api -os p2v_data -op /tmp/rhvpasswd -oo rhv-cafile=/home/ca.pem -oo rhv-direct=true -oo rhv-cluster=p2v
Exception AttributeError: "'module' object has no attribute 'dump_plugin'" in <module 'threading' from '/usr/lib64/python2.7/threading.pyc'> ignored
[   0.8] Opening the source -i libvirt -ic vpx://root.73.141/data/10.73.75.219/?no_verify=1 esx6.7-rhel7.6-x86_64
[   3.4] Creating an overlay to protect the source from being modified
[   4.5] Opening the overlay
[  81.7] Inspecting the overlay
[ 308.9] Checking for sufficient free disk space in the guest
[ 308.9] Estimating space required on target for each disk
[ 308.9] Converting Red Hat Enterprise Linux Server 7.6 (Maipo) to run on KVM
virt-v2v: This guest has virtio drivers installed.
[1785.5] Mapping filesystem data to avoid copying unused and blank areas
[1787.5] Closing the overlay
[1787.9] Assigning disks to buses
[1787.9] Checking if the guest needs BIOS or UEFI to boot
[1787.9] Initializing the target -o rhv-upload -oc https://ibm-x3250m5-03.rhts.eng.pek2.redhat.com/ovirt-engine/api -op /tmp/rhvpasswd -os p2v_data
[1789.4] Copying disk 1/1 to qemu URI json:{ "file.driver": "nbd", "file.path": "/var/tmp/rhvupload.5nKw4Z/nbdkit0.sock", "file.export": "/" } (raw)
nbdkit: python[1]: error: /var/tmp/v2v.JI61Tq/rhv-upload-plugin.py: pwrite: error: ['Traceback (most recent call last):\n', '  File "/var/tmp/v2v.JI61Tq/rhv-upload-plugin.py", line 407, in pwrite\n    (offset, count))\n', '  File "/var/tmp/v2v.JI61Tq/rhv-upload-plugin.py", line 355, in request_failed\n    raise RuntimeError("%s: %d %s: %r" % (msg, status, reason, body[:200]))\n', "RuntimeError: could not write sector offset 2795503616 size 16384: 403 Forbidden: 'You are not allowed to access this resource: Ticket 3f7867e5-5c86-47bb-a44e-da754e9389f3 expired'\n"]
qemu-img: error while writing sector 5459968: Input/output error

nbdkit: python[1]: error: /var/tmp/v2v.JI61Tq/rhv-upload-plugin.py: flush: error: ['Traceback (most recent call last):\n', '  File "/var/tmp/v2v.JI61Tq/rhv-upload-plugin.py", line 510, in flush\n    request_failed(h, r, "could not flush")\n', '  File "/var/tmp/v2v.JI61Tq/rhv-upload-plugin.py", line 355, in request_failed\n    raise RuntimeError("%s: %d %s: %r" % (msg, status, reason, body[:200]))\n', "RuntimeError: could not flush: 403 Forbidden: 'You are not allowed to access this resource: Ticket 3f7867e5-5c86-47bb-a44e-da754e9389f3 expired'\n"]
nbdkit: python[1]: error: /var/tmp/v2v.JI61Tq/rhv-upload-plugin.py: flush: error: ['Traceback (most recent call last):\n', '  File "/var/tmp/v2v.JI61Tq/rhv-upload-plugin.py", line 510, in flush\n    request_failed(h, r, "could not flush")\n', '  File "/var/tmp/v2v.JI61Tq/rhv-upload-plugin.py", line 355, in request_failed\n    raise RuntimeError("%s: %d %s: %r" % (msg, status, reason, body[:200]))\n', "RuntimeError: could not flush: 403 Forbidden: 'You are not allowed to access this resource: Ticket 3f7867e5-5c86-47bb-a44e-da754e9389f3 expired'\n"]
virt-v2v: error: qemu-img command failed, see earlier errors

If reporting bugs, run virt-v2v with debugging enabled and include the 
complete output:

  virt-v2v -v -x [...]
nbdkit: python[1]: error: /var/tmp/v2v.JI61Tq/rhv-upload-plugin.py: close: error: ['Traceback (most recent call last):\n', '  File "/var/tmp/v2v.JI61Tq/rhv-upload-plugin.py", line 530, in close\n    delete_disk_on_failure(h)\n', '  File "/var/tmp/v2v.JI61Tq/rhv-upload-plugin.py", line 516, in delete_disk_on_failure\n    disk_service.remove()\n', '  File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 37373, in remove\n    self._internal_remove(headers, query, wait)\n', '  File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 271, in _internal_remove\n    return future.wait() if wait else future\n', '  File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait\n    return self._code(response)\n', '  File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 268, in callback\n    self._check_fault(response)\n', '  File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 132, in _check_fault\n    self._raise_error(response, body)\n', '  File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error\n    raise error\n', 'Error: Fault reason is "Operation Failed". Fault detail is "[Cannot remove Virtual Disk. Related operation is currently in progress. Please try again later.]". HTTP response code is 409.\n']


Result:
    The error info has been improved when make the ticket of v2v conversion expired on standalone v2v server,so change the bug from ON_QA to VERIFIED.

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:1082