Bug 878894

Summary: 3.2 - VDSM - Storage: updateVM fails and causes SPM re-election
Product: Red Hat Enterprise Linux 6 Reporter: Daniel Paikov <dpaikov>
Component: vdsmAssignee: Federico Simoncelli <fsimonce>
Status: CLOSED DUPLICATE QA Contact: Haim <hateya>
Severity: high Docs Contact:
Priority: medium    
Version: 6.3CC: abaron, bazulay, ewarszaw, hateya, iheim, lpeer, yeylon, ykaul
Target Milestone: rc   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard: Storage
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2012-12-26 10:59:37 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
vdsm.log
none
engine.log none

Description Daniel Paikov 2012-11-21 13:33:59 UTC
Created attachment 649224 [details]
vdsm.log

* Remove multiple virtual disks from the same VM, one after another.
* Multiple instances of updateVM try to write to the same OVF file.
* Some of the updateVM instances can't find the OVF file and throw an exception.
* Engine thinks that RemoveDisk fails and forces an SPM re-election.

Thread-44141::ERROR::2012-11-21 13:17:41,026::task::853::TaskManager.Task::(_setError) Task=`8292c98c-9a5f-419d-a67a-51eaca001fdf`::Unexpected error
Traceback (most recent call last):
  File "/usr/share/vdsm/storage/task.py", line 861, in _run
    return fn(*args, **kargs)
  File "/usr/share/vdsm/logUtils.py", line 38, in wrapper
    res = f(*args, **kwargs)
  File "/usr/share/vdsm/storage/hsm.py", line 1146, in updateVM
    pool.updateVM(vmList=vmList, sdUUID=sdUUID)
  File "/usr/share/vdsm/storage/securable.py", line 63, in wrapper
    return f(self, *args, **kwargs)
  File "/usr/share/vdsm/storage/sp.py", line 1287, in updateVM
    encoding='utf8').write(ovf)
  File "/usr/lib64/python2.6/codecs.py", line 881, in open
    file = __builtin__.open(filename, mode, buffering)
IOError: [Errno 2] No such file or directory: '/rhev/data-center/mnt/orion.qa.lab:_export_paikov39/23059eeb-bd81-4f5b-9b0a-e4b070718ec7/master/vms/5807fe39-3857-44ba-8d61-3d29eb8de5ed/5807fe39-3857-44ba-8d61-3d29eb8de5ed.ovf'

Comment 2 Haim 2012-11-21 16:59:13 UTC
please attach engine logs as well.

Comment 3 Daniel Paikov 2012-11-22 07:54:11 UTC
Created attachment 649562 [details]
engine.log

Comment 4 Eduardo Warszawski 2012-11-25 22:46:07 UTC
Multiple ovf file update and/or remove should be serialized in the Engine.
Simoultaneous requests can be served out of order leading to inconsistent or outdated ovf files.

http://gerrit.ovirt.org/#/c/9456/

Comment 5 RHEL Program Management 2012-12-14 07:18:35 UTC
This request was not resolved in time for the current release.
Red Hat invites you to ask your support representative to
propose this request, if still desired, for consideration in
the next release of Red Hat Enterprise Linux.

Comment 6 Ayal Baron 2012-12-26 10:59:37 UTC
Should be solved by bug 882718

*** This bug has been marked as a duplicate of bug 882718 ***