Bug 915809

Summary: RHEVM Backend : Sometimes event that VM removed was finished is not created
Product: Red Hat Enterprise Virtualization Manager Reporter: Barak Dagan <bdagan>
Component: ovirt-engineAssignee: Arik <ahadas>
Status: CLOSED WONTFIX QA Contact: Barak Dagan <bdagan>
Severity: high Docs Contact:
Priority: unspecified    
Version: 3.1.2CC: acathrow, iheim, jkt, lpeer, michal.skrivanek, mpastern, oramraz, pstehlik, Rhev-m-bugs, yeylon
Target Milestone: ---   
Target Release: 3.4.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard: virt
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2014-01-05 10:50:20 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 860194    
Bug Blocks: 916652    
Attachments:
Description Flags
engine log none

Description Barak Dagan 2013-02-26 14:55:25 UTC 
Created attachment 702929 [details]
engine log

Description of problem:
When remove VM is finished, there should be created event about this with same correlation id as start has.

<events>
    <event href="/api/events/2097" id="2097">
        <description>VM restvm_migration was successfully removed.</description>
        <code>113</code>
        <severity>normal</severity>
        <time>2013-02-22T00:12:27.981+02:00</time>
        <correlation_id>526</correlation_id>
        <vm href="/api/vms/a6876512-4741-40fd-9c2b-95a171c4b47b" id="a6876512-4741-40fd-9c2b-95a171c4b47b"/>
        <cluster href="/api/clusters/6c801448-7c6f-11e2-8f09-001a4a169764" id="6c801448-7c6f-11e2-8f09-001a4a169764"/>
        <data_center href="/api/datacenters/dd88a20c-9f4a-4da7-abbf-41a0248bbabd" id="dd88a20c-9f4a-4da7-abbf-41a0248bbabd"/>
    </event>
    <event href="/api/events/2068" id="2068">
        <description>Removal of VM restvm_migration was initiated by admin@internal.</description>
        <code>36</code>
        <severity>normal</severity>
        <time>2013-02-22T00:12:22.184+02:00</time>
        <correlation_id>526</correlation_id>
        <user href="/api/users/fdfc627c-d875-11e0-90f0-83df133b58cc" id="fdfc627c-d875-11e0-90f0-83df133b58cc"/>
        <vm href="/api/vms/a6876512-4741-40fd-9c2b-95a171c4b47b" id="a6876512-4741-40fd-9c2b-95a171c4b47b"/>
        <cluster href="/api/clusters/6c801448-7c6f-11e2-8f09-001a4a169764" id="6c801448-7c6f-11e2-8f09-001a4a169764"/>
        <data_center href="/api/datacenters/dd88a20c-9f4a-4da7-abbf-41a0248bbabd" id="dd88a20c-9f4a-4da7-abbf-41a0248bbabd"/>
    </event>
    <event href="/api/events/2095" id="2095">
        <description>VM rest_testPool-1 was successfully removed.</description>
        <code>113</code>
        <severity>normal</severity>
        <time>2013-02-22T00:12:27.941+02:00</time>
        <correlation_id>526</correlation_id>
        <vm href="/api/vms/8a5dc911-14f4-49cb-8e4b-3974938faca3" id="8a5dc911-14f4-49cb-8e4b-3974938faca3"/>
        <template href="/api/templates/a5e554cd-b1a2-41e2-9df5-0a44f932f830" id="a5e554cd-b1a2-41e2-9df5-0a44f932f830"/>
        <cluster href="/api/clusters/6c801448-7c6f-11e2-8f09-001a4a169764" id="6c801448-7c6f-11e2-8f09-001a4a169764"/>
        <data_center href="/api/datacenters/dd88a20c-9f4a-4da7-abbf-41a0248bbabd" id="dd88a20c-9f4a-4da7-abbf-41a0248bbabd"/>
    </event>
    <event href="/api/events/2084" id="2084">
        <description>Removal of VM rest_testPool-1 was initiated by admin@internal.</description>
        <code>36</code>
        <severity>normal</severity>
        <time>2013-02-22T00:12:26.285+02:00</time>
        <correlation_id>526</correlation_id>
        <user href="/api/users/fdfc627c-d875-11e0-90f0-83df133b58cc" id="fdfc627c-d875-11e0-90f0-83df133b58cc"/>
        <vm href="/api/vms/8a5dc911-14f4-49cb-8e4b-3974938faca3" id="8a5dc911-14f4-49cb-8e4b-3974938faca3"/>
        <template href="/api/templates/a5e554cd-b1a2-41e2-9df5-0a44f932f830" id="a5e554cd-b1a2-41e2-9df5-0a44f932f830"/>
        <cluster href="/api/clusters/6c801448-7c6f-11e2-8f09-001a4a169764" id="6c801448-7c6f-11e2-8f09-001a4a169764"/>
        <data_center href="/api/datacenters/dd88a20c-9f4a-4da7-abbf-41a0248bbabd" id="dd88a20c-9f4a-4da7-abbf-41a0248bbabd"/>
    </event>
--------------------------------------------------------
    <event href="/api/events/2094" id="2094">
        <description>Removal of VM restvm_templates2 was initiated by admin@internal.</description>
        <code>36</code>
        <severity>normal</severity>
        <time>2013-02-22T00:12:27.937+02:00</time>
        <correlation_id>526</correlation_id>
        <user href="/api/users/fdfc627c-d875-11e0-90f0-83df133b58cc" id="fdfc627c-d875-11e0-90f0-83df133b58cc"/>
        <vm href="/api/vms/3e9ea357-c030-43be-84d7-3c0e99dce953" id="3e9ea357-c030-43be-84d7-3c0e99dce953"/>
        <template href="/api/templates/a5e554cd-b1a2-41e2-9df5-0a44f932f830" id="a5e554cd-b1a2-41e2-9df5-0a44f932f830"/>
        <cluster href="/api/clusters/6c801448-7c6f-11e2-8f09-001a4a169764" id="6c801448-7c6f-11e2-8f09-001a4a169764"/>
        <data_center href="/api/datacenters/dd88a20c-9f4a-4da7-abbf-41a0248bbabd" id="dd88a20c-9f4a-4da7-abbf-41a0248bbabd"/>
    </event>
--------------------------------------------------------
    <event href="/api/events/2093" id="2093">
        <description>VM rest_testPoolUpd-1 was successfully removed.</description>
        <code>113</code>
        <severity>normal</severity>
        <time>2013-02-22T00:12:27.827+02:00</time>
        <correlation_id>526</correlation_id>
        <vm href="/api/vms/99abfc0b-b56a-4024-83d5-10431b31929d" id="99abfc0b-b56a-4024-83d5-10431b31929d"/>
        <template href="/api/templates/a5e554cd-b1a2-41e2-9df5-0a44f932f830" id="a5e554cd-b1a2-41e2-9df5-0a44f932f830"/>
        <cluster href="/api/clusters/6c801448-7c6f-11e2-8f09-001a4a169764" id="6c801448-7c6f-11e2-8f09-001a4a169764"/>
        <data_center href="/api/datacenters/dd88a20c-9f4a-4da7-abbf-41a0248bbabd" id="dd88a20c-9f4a-4da7-abbf-41a0248bbabd"/>
    </event>
    <event href="/api/events/2080" id="2080">
        <description>Removal of VM rest_testPoolUpd-1 was initiated by admin@internal.</description>
        <code>36</code>
        <severity>normal</severity>
        <time>2013-02-22T00:12:25.316+02:00</time>
        <correlation_id>526</correlation_id>
        <user href="/api/users/fdfc627c-d875-11e0-90f0-83df133b58cc" id="fdfc627c-d875-11e0-90f0-83df133b58cc"/>
        <vm href="/api/vms/99abfc0b-b56a-4024-83d5-10431b31929d" id="99abfc0b-b56a-4024-83d5-10431b31929d"/>
        <template href="/api/templates/a5e554cd-b1a2-41e2-9df5-0a44f932f830" id="a5e554cd-b1a2-41e2-9df5-0a44f932f830"/>
        <cluster href="/api/clusters/6c801448-7c6f-11e2-8f09-001a4a169764" id="6c801448-7c6f-11e2-8f09-001a4a169764"/>
        <data_center href="/api/datacenters/dd88a20c-9f4a-4da7-abbf-41a0248bbabd" id="dd88a20c-9f4a-4da7-abbf-41a0248bbabd"/>
    </event>
    <event href="/api/events/2092" id="2092">
        <description>VM restvm_run_once was successfully removed.</description>
        <code>113</code>
        <severity>normal</severity>
        <time>2013-02-22T00:12:27.816+02:00</time>
        <correlation_id>526</correlation_id>
        <vm href="/api/vms/104c0f2f-9d85-4aeb-934e-a3ce1331ba9e" id="104c0f2f-9d85-4aeb-934e-a3ce1331ba9e"/>
        <cluster href="/api/clusters/6c801448-7c6f-11e2-8f09-001a4a169764" id="6c801448-7c6f-11e2-8f09-001a4a169764"/>
        <data_center href="/api/datacenters/dd88a20c-9f4a-4da7-abbf-41a0248bbabd" id="dd88a20c-9f4a-4da7-abbf-41a0248bbabd"/>
    </event>
    <event href="/api/events/2072" id="2072">
        <description>Removal of VM restvm_run_once was initiated by admin@internal.</description>
        <code>36</code>
        <severity>normal</severity>
        <time>2013-02-22T00:12:23.202+02:00</time>
        <correlation_id>526</correlation_id>
        <user href="/api/users/fdfc627c-d875-11e0-90f0-83df133b58cc" id="fdfc627c-d875-11e0-90f0-83df133b58cc"/>
        <vm href="/api/vms/104c0f2f-9d85-4aeb-934e-a3ce1331ba9e" id="104c0f2f-9d85-4aeb-934e-a3ce1331ba9e"/>
        <cluster href="/api/clusters/6c801448-7c6f-11e2-8f09-001a4a169764" id="6c801448-7c6f-11e2-8f09-001a4a169764"/>
        <data_center href="/api/datacenters/dd88a20c-9f4a-4da7-abbf-41a0248bbabd" id="dd88a20c-9f4a-4da7-abbf-41a0248bbabd"/>
    </event>
    <event href="/api/events/2091" id="2091">
        <description>VM rest_testPool-2 was successfully removed.</description>
        <code>113</code>
        <severity>normal</severity>
        <time>2013-02-22T00:12:27.805+02:00</time>
        <correlation_id>526</correlation_id>
        <vm href="/api/vms/f75e2bfa-24a3-4802-b475-c22e1efdc436" id="f75e2bfa-24a3-4802-b475-c22e1efdc436"/>
        <template href="/api/templates/a5e554cd-b1a2-41e2-9df5-0a44f932f830" id="a5e554cd-b1a2-41e2-9df5-0a44f932f830"/>
        <cluster href="/api/clusters/6c801448-7c6f-11e2-8f09-001a4a169764" id="6c801448-7c6f-11e2-8f09-001a4a169764"/>
        <data_center href="/api/datacenters/dd88a20c-9f4a-4da7-abbf-41a0248bbabd" id="dd88a20c-9f4a-4da7-abbf-41a0248bbabd"/>
    </event>
    <event href="/api/events/2076" id="2076">
        <description>Removal of VM rest_testPool-2 was initiated by admin@internal.</description>
        <code>36</code>
        <severity>normal</severity>
        <time>2013-02-22T00:12:24.246+02:00</time>
        <correlation_id>526</correlation_id>
        <user href="/api/users/fdfc627c-d875-11e0-90f0-83df133b58cc" id="fdfc627c-d875-11e0-90f0-83df133b58cc"/>
        <vm href="/api/vms/f75e2bfa-24a3-4802-b475-c22e1efdc436" id="f75e2bfa-24a3-4802-b475-c22e1efdc436"/>
        <template href="/api/templates/a5e554cd-b1a2-41e2-9df5-0a44f932f830" id="a5e554cd-b1a2-41e2-9df5-0a44f932f830"/>
        <cluster href="/api/clusters/6c801448-7c6f-11e2-8f09-001a4a169764" id="6c801448-7c6f-11e2-8f09-001a4a169764"/>
        <data_center href="/api/datacenters/dd88a20c-9f4a-4da7-abbf-41a0248bbabd" id="dd88a20c-9f4a-4da7-abbf-41a0248bbabd"/>
    </event>
    <event href="/api/events/2090" id="2090">
        <description>VM restvm_templates_sd was successfully removed.</description>
        <code>113</code>
        <severity>normal</severity>
        <time>2013-02-22T00:12:27.739+02:00</time>
        <correlation_id>526</correlation_id>
        <vm href="/api/vms/bdbb508a-0a60-41f7-a573-4e8440d0622e" id="bdbb508a-0a60-41f7-a573-4e8440d0622e"/>
        <template href="/api/templates/a5e554cd-b1a2-41e2-9df5-0a44f932f830" id="a5e554cd-b1a2-41e2-9df5-0a44f932f830"/>
        <cluster href="/api/clusters/6c801448-7c6f-11e2-8f09-001a4a169764" id="6c801448-7c6f-11e2-8f09-001a4a169764"/>
        <data_center href="/api/datacenters/dd88a20c-9f4a-4da7-abbf-41a0248bbabd" id="dd88a20c-9f4a-4da7-abbf-41a0248bbabd"/>
    </event>
    <event href="/api/events/2064" id="2064">
        <description>Removal of VM restvm_templates_sd was initiated by admin@internal.</description>
        <code>36</code>
        <severity>normal</severity>
        <time>2013-02-22T00:12:21.141+02:00</time>
        <correlation_id>526</correlation_id>
        <user href="/api/users/fdfc627c-d875-11e0-90f0-83df133b58cc" id="fdfc627c-d875-11e0-90f0-83df133b58cc"/>
        <vm href="/api/vms/bdbb508a-0a60-41f7-a573-4e8440d0622e" id="bdbb508a-0a60-41f7-a573-4e8440d0622e"/>
        <template href="/api/templates/a5e554cd-b1a2-41e2-9df5-0a44f932f830" id="a5e554cd-b1a2-41e2-9df5-0a44f932f830"/>
        <cluster href="/api/clusters/6c801448-7c6f-11e2-8f09-001a4a169764" id="6c801448-7c6f-11e2-8f09-001a4a169764"/>
        <data_center href="/api/datacenters/dd88a20c-9f4a-4da7-abbf-41a0248bbabd" id="dd88a20c-9f4a-4da7-abbf-41a0248bbabd"/>
    </event>
    <event href="/api/events/2089" id="2089">
        <description>VM restvm_templates_cloned was successfully removed.</description>
        <code>113</code>
        <severity>normal</severity>
        <time>2013-02-22T00:12:27.702+02:00</time>
        <correlation_id>526</correlation_id>
        <vm href="/api/vms/cac527d3-a237-40ec-9294-26179c02fca3" id="cac527d3-a237-40ec-9294-26179c02fca3"/>
        <cluster href="/api/clusters/6c801448-7c6f-11e2-8f09-001a4a169764" id="6c801448-7c6f-11e2-8f09-001a4a169764"/>
        <data_center href="/api/datacenters/dd88a20c-9f4a-4da7-abbf-41a0248bbabd" id="dd88a20c-9f4a-4da7-abbf-41a0248bbabd"/>
    </event>
    <event href="/api/events/2060" id="2060">
        <description>Removal of VM restvm_templates_cloned was initiated by admin@internal.</description>
        <code>36</code>
        <severity>normal</severity>
        <time>2013-02-22T00:12:19.999+02:00</time>
        <correlation_id>526</correlation_id>
        <user href="/api/users/fdfc627c-d875-11e0-90f0-83df133b58cc" id="fdfc627c-d875-11e0-90f0-83df133b58cc"/>
        <vm href="/api/vms/cac527d3-a237-40ec-9294-26179c02fca3" id="cac527d3-a237-40ec-9294-26179c02fca3"/>
        <cluster href="/api/clusters/6c801448-7c6f-11e2-8f09-001a4a169764" id="6c801448-7c6f-11e2-8f09-001a4a169764"/>
        <data_center href="/api/datacenters/dd88a20c-9f4a-4da7-abbf-41a0248bbabd" id="dd88a20c-9f4a-4da7-abbf-41a0248bbabd"/>
    </event>
    <event href="/api/events/2088" id="2088">
        <description>VM restvm_templates was successfully removed.</description>
        <code>113</code>
        <severity>normal</severity>
        <time>2013-02-22T00:12:27.669+02:00</time>
        <correlation_id>526</correlation_id>
        <vm href="/api/vms/a92432b4-3559-4fe3-afdf-684efd644b8e" id="a92432b4-3559-4fe3-afdf-684efd644b8e"/>
        <cluster href="/api/clusters/6c801448-7c6f-11e2-8f09-001a4a169764" id="6c801448-7c6f-11e2-8f09-001a4a169764"/>
        <data_center href="/api/datacenters/dd88a20c-9f4a-4da7-abbf-41a0248bbabd" id="dd88a20c-9f4a-4da7-abbf-41a0248bbabd"/>
    </event>
    <event href="/api/events/2055" id="2055">
        <description>Removal of VM restvm_templates was initiated by admin@internal.</description>
        <code>36</code>
        <severity>normal</severity>
        <time>2013-02-22T00:12:18.904+02:00</time>
        <correlation_id>526</correlation_id>
        <user href="/api/users/fdfc627c-d875-11e0-90f0-83df133b58cc" id="fdfc627c-d875-11e0-90f0-83df133b58cc"/>
        <vm href="/api/vms/a92432b4-3559-4fe3-afdf-684efd644b8e" id="a92432b4-3559-4fe3-afdf-684efd644b8e"/>
        <cluster href="/api/clusters/6c801448-7c6f-11e2-8f09-001a4a169764" id="6c801448-7c6f-11e2-8f09-001a4a169764"/>
        <data_center href="/api/datacenters/dd88a20c-9f4a-4da7-abbf-41a0248bbabd" id="dd88a20c-9f4a-4da7-abbf-41a0248bbabd"/>
    </event>
--------------------------------------------------------
    <event href="/api/events/1994" id="1994">
        <description>VM Pool rest_testPoolUpd was removed by admin@internal.</description>
        <code>304</code>
        <severity>normal</severity>
        <time>2013-02-22T00:12:16.459+02:00</time>
        <correlation_id>526</correlation_id>
        <user href="/api/users/fdfc627c-d875-11e0-90f0-83df133b58cc" id="fdfc627c-d875-11e0-90f0-83df133b58cc"/>
        <cluster href="/api/clusters/6c801448-7c6f-11e2-8f09-001a4a169764" id="6c801448-7c6f-11e2-8f09-001a4a169764"/>
    </event>
</events>
 

2013-02-22 00:12:29,387 - JobsSet - events - DEBUG - Response code is valid: [200, 201] 
2013-02-22 00:12:29,395 - JobsSet - events - ERROR - Collection size is wrong, expected is: 19, actual is: 18 

in the above event collection, there should be two events:
- Removal of VM myvm was initiated by admin@internal
- VM myvm was successfully removed

in the dashed line can be seen that 2nd event is missing.

Version-Release number of selected component (if applicable):
si27.1

How reproducible:
30%

Steps to Reproduce:
1. Remove many vms at once
2. After task is completed, check events with given correlation id
  
Additional info:
Logs are attached
Comment 1 Oded Ramraz 2013-02-27 07:58:41 UTC 
this issue is quite similar to https://bugzilla.redhat.com/show_bug.cgi?id=860194
Comment 2 Michal Skrivanek 2013-02-27 14:17:49 UTC 
(In reply to comment #1)
> this issue is quite similar to
> https://bugzilla.redhat.com/show_bug.cgi?id=860194
though not as simple to fix. Proposing 3.3 dor this one. We need a proper infra support
Comment 3 Arik 2013-02-27 15:25:34 UTC 
It's not the same because for export template command there was monitoring of VDSM tasks that could be changed to monitor the job status quite easily, and it solved the problem.
For remove vm command there is no monitoring that can be easily changed.
Comment 4 Barak Dagan 2013-02-28 09:03:57 UTC 
(In reply to comment #0)
> Created attachment 702929 [details]
> engine log
> 
> 
> 2013-02-22 00:12:29,387 - JobsSet - events - DEBUG - Response code is valid:
> [200, 201] 
> 2013-02-22 00:12:29,395 - JobsSet - events - ERROR - Collection size is
> wrong, expected is: 19, actual is: 18 
> 
> in the above event collection, there should be two events:
> - Removal of VM myvm was initiated by admin@internal
> - VM myvm was successfully removed
> 
> in the dashed line can be seen that 2nd event is missing.
> 
> Version-Release number of selected component (if applicable):
> si27.1
> 
> How reproducible:
> 30%
> 
> Steps to Reproduce:
> 1. Remove many vms at once
> 2. After task is completed, check events with given correlation id
>   
> Additional info:
> Logs are attached


Forgot to attach test link, sorry:

http://jenkins.qa.lab.tlv.redhat.com:8080/view/Core+Tools/view/3.1/job/3.1-automation_restapi_reg_vms_rhevh/66/
Comment 5 Michal Skrivanek 2013-07-16 12:48:04 UTC 
regarding comment #2, do we have a proper support in REST in general?
Comment 6 Itamar Heim 2014-01-05 10:50:20 UTC 
Closing old bugs. If this issue is still relevant/important in current version, please re-open the bug.
Comment 7 Red Hat Bugzilla 2023-09-14 01:41:42 UTC 
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 1000 days