Bug 1713371 - Attempting to endAction 'RemoveVm' throws ConcurrentModificationException.
Summary: Attempting to endAction 'RemoveVm' throws ConcurrentModificationException.
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: ovirt-engine
Classification: oVirt
Component: BLL.Virt
Version: 4.3.4
Hardware: x86_64
OS: Linux
unspecified
high
Target Milestone: ovirt-4.3.5
: 4.3.5.1
Assignee: Dana
QA Contact: Polina
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2019-05-23 13:41 UTC by Polina
Modified: 2019-07-30 14:08 UTC (History)
6 users (show)

Fixed In Version: ovirt-engine-4.3.5.1
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2019-07-30 14:08:18 UTC
oVirt Team: Infra
Embargoed:
pm-rhel: ovirt-4.3+


Attachments (Terms of Use)
engine & vdsm logs (9.21 MB, application/gzip)
2019-05-23 13:41 UTC, Polina
no flags Details


Links
System ID Private Priority Status Summary Last Updated
oVirt gerrit 100394 0 master MERGED engine: use ConcurrentHashMap for contextsMap 2019-06-12 13:39:21 UTC
oVirt gerrit 100785 0 ovirt-engine-4.3 MERGED engine: use ConcurrentHashMap for contextsMap 2019-06-13 08:23:38 UTC

Description Polina 2019-05-23 13:41:07 UTC
Created attachment 1572535 [details]
engine & vdsm logs

Description of problem:

2019-05-21 20:07:40,085+03 INFO  [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (EE-ManagedThreadFactory-engine-Thread-20) [] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction 'RemoveVm',
2019-05-21 20:07:40,109+03 ERROR [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (EE-ManagedThreadFactory-engine-Thread-19) [] [within thread]: endAction for action type RemoveVm threw an exception.: java.util.ConcurrentModificationException
        at java.util.HashMap$HashIterator.nextNode(HashMap.java:1445) [rt.jar:1.8.0_212]


This causes hanging task which prevents normal functioning of many actions in the environment, like forceselectspm , maintenance:

2019-05-21 20:10:18,826+03 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-18) [hosts_syncAction_5feaaa84-61df-47c4] EVENT_ID: VDS_ALERT_NOT_STOPPING_SPM_UNCLEARED_TASKS(9,030), Not stopping SPM on vds host_mixed_2, pool id 6981a7d5-07b7-47b8-83fc-7154853fe22c as there are uncleared tasks Task '571860c4-471c-4316-bff7-b13363501cd2', status 'finished'
Task '5de74f1b-5a8b-40e0-a5b3-775e4f078414', status 'finished'

engine and vdsm logs attached 


Version-Release number of selected component (if applicable):
ovirt-engine-4.3.4-0.1.el7.noarch

How reproducible: happened in automation run.

Comment 1 Ryan Barry 2019-05-24 01:13:31 UTC
Tal, looks like a dupe of https://bugzilla.redhat.com/show_bug.cgi?id=1664045, yes?

Comment 3 Tal Nisan 2019-05-27 15:29:38 UTC
(In reply to Ryan Barry from comment #1)
> Tal, looks like a dupe of
> https://bugzilla.redhat.com/show_bug.cgi?id=1664045, yes?

Doesn't seem like it, what makes you think it is?

Comment 4 Ryan Barry 2019-05-28 10:20:01 UTC
(In reply to Tal Nisan from comment #3)
> (In reply to Ryan Barry from comment #1)
> > Tal, looks like a dupe of
> > https://bugzilla.redhat.com/show_bug.cgi?id=1664045, yes?
> 
> Doesn't seem like it, what makes you think it is?

The ConcurrentModificationException is definitely an infra problem, but a failure to deactivate the SPM leading to all tasks which interact with it (selecting SPM, maintenance, etc) to fail seems to be 1664045

Comment 5 Polina 2019-07-01 10:50:29 UTC
verified on ovirt-engine-4.3.5.2-0.1.el7.noarch

Comment 6 Sandro Bonazzola 2019-07-30 14:08:18 UTC
This bugzilla is included in oVirt 4.3.5 release, published on July 30th 2019.

Since the problem described in this bug report should be
resolved in oVirt 4.3.5 release, it has been closed with a resolution of CURRENT RELEASE.

If the solution does not work for you, please open a new bug report.


Note You need to log in before you can comment on or make changes to this bug.