Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1713371

Summary: Attempting to endAction 'RemoveVm' throws ConcurrentModificationException.
Product: [oVirt] ovirt-engine Reporter: Polina <pagranat>
Component: BLL.VirtAssignee: Dana <delfassy>
Status: CLOSED CURRENTRELEASE QA Contact: Polina <pagranat>
Severity: high Docs Contact:
Priority: unspecified    
Version: 4.3.4CC: bugs, delfassy, lrotenbe, mperina, rbarry, tnisan
Target Milestone: ovirt-4.3.5Keywords: Automation
Target Release: 4.3.5.1Flags: pm-rhel: ovirt-4.3+
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: ovirt-engine-4.3.5.1 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2019-07-30 14:08:18 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Infra RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
engine & vdsm logs none

Description Polina 2019-05-23 13:41:07 UTC
Created attachment 1572535 [details]
engine & vdsm logs

Description of problem:

2019-05-21 20:07:40,085+03 INFO  [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (EE-ManagedThreadFactory-engine-Thread-20) [] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction 'RemoveVm',
2019-05-21 20:07:40,109+03 ERROR [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (EE-ManagedThreadFactory-engine-Thread-19) [] [within thread]: endAction for action type RemoveVm threw an exception.: java.util.ConcurrentModificationException
        at java.util.HashMap$HashIterator.nextNode(HashMap.java:1445) [rt.jar:1.8.0_212]


This causes hanging task which prevents normal functioning of many actions in the environment, like forceselectspm , maintenance:

2019-05-21 20:10:18,826+03 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-18) [hosts_syncAction_5feaaa84-61df-47c4] EVENT_ID: VDS_ALERT_NOT_STOPPING_SPM_UNCLEARED_TASKS(9,030), Not stopping SPM on vds host_mixed_2, pool id 6981a7d5-07b7-47b8-83fc-7154853fe22c as there are uncleared tasks Task '571860c4-471c-4316-bff7-b13363501cd2', status 'finished'
Task '5de74f1b-5a8b-40e0-a5b3-775e4f078414', status 'finished'

engine and vdsm logs attached 


Version-Release number of selected component (if applicable):
ovirt-engine-4.3.4-0.1.el7.noarch

How reproducible: happened in automation run.

Comment 1 Ryan Barry 2019-05-24 01:13:31 UTC
Tal, looks like a dupe of https://bugzilla.redhat.com/show_bug.cgi?id=1664045, yes?

Comment 3 Tal Nisan 2019-05-27 15:29:38 UTC
(In reply to Ryan Barry from comment #1)
> Tal, looks like a dupe of
> https://bugzilla.redhat.com/show_bug.cgi?id=1664045, yes?

Doesn't seem like it, what makes you think it is?

Comment 4 Ryan Barry 2019-05-28 10:20:01 UTC
(In reply to Tal Nisan from comment #3)
> (In reply to Ryan Barry from comment #1)
> > Tal, looks like a dupe of
> > https://bugzilla.redhat.com/show_bug.cgi?id=1664045, yes?
> 
> Doesn't seem like it, what makes you think it is?

The ConcurrentModificationException is definitely an infra problem, but a failure to deactivate the SPM leading to all tasks which interact with it (selecting SPM, maintenance, etc) to fail seems to be 1664045

Comment 5 Polina 2019-07-01 10:50:29 UTC
verified on ovirt-engine-4.3.5.2-0.1.el7.noarch

Comment 6 Sandro Bonazzola 2019-07-30 14:08:18 UTC
This bugzilla is included in oVirt 4.3.5 release, published on July 30th 2019.

Since the problem described in this bug report should be
resolved in oVirt 4.3.5 release, it has been closed with a resolution of CURRENT RELEASE.

If the solution does not work for you, please open a new bug report.