Bug 1487728 – If VM is down and 'run_on_vds' is still set, errors are reported in engine and server logs

Bugzilla will be upgraded to version 5.0. The upgrade date is tentatively scheduled for 2 December 2018, pending final testing and feedback.

Bug 1487728 - If VM is down and 'run_on_vds' is still set, errors are reported in engine and server logs

Summary:	If VM is down and 'run_on_vds' is still set, errors are reported in engine an...

Status:	CLOSED ERRATA

Aliases:	None

Product:	Red Hat Enterprise Virtualization Manager
Classification:	Red Hat
Component:	ovirt-engine (Show other bugs)
Sub Component:
Version:	4.1.2
Hardware:	Unspecified Linux

Priority	medium Severity high
Target Milestone:	ovirt-4.2.0
Target Release:	---
Assigned To:	Arik
QA Contact:	Nisim Simsolo
Docs Contact:

URL:
Whiteboard:
Keywords:	ZStream

Depends On:
Blocks:	1489677
	Show dependency tree / graph

Reported:	2017-09-01 14:27 EDT by Gordon Watson
Modified:	2018-05-15 13:45 EDT (History)
CC List:	13 users (show)

See Also:
Fixed In Version:
Doc Type:	No Doc Update
Doc Text:	undefined
Story Points:	---
Clone Of:
Clones:	1489677 (view as bug list)
Environment:
Last Closed:	2018-05-15 13:43:37 EDT
Type:	Bug
Regression:	---
Mount Type:	---
Documentation:	---
CRM:
Verified Versions:
Category:	---
oVirt Team:	Virt
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---

Attachments	(Terms of Use)
Add an attachment (proposed patch, testcase, etc.)

External Trackers
Tracker	ID	Priority	Status	Summary	Last Updated
oVirt gerrit	81412	master	POST	core: update the required fields when vm disappears	2017-09-04 10:45 EDT
oVirt gerrit	81517	ovirt-engine-4.1	POST	core: update the required fields when vm disappears	2017-09-06 08:48 EDT
oVirt gerrit	81518	ovirt-engine-4.1	POST	core: prevent NPE when vm disappears from the host	2017-09-06 08:49 EDT
oVirt gerrit	81560	None	None	None	2017-10-03 08:49 EDT
Red Hat Product Errata	RHEA-2018:1488	None	None	None	2018-05-15 13:45 EDT

Groups: None (edit)

Description Gordon Watson 2017-09-01 14:27:33 EDT

Description of problem:

If 'run_on_vds' in the vm_dynamic table in the RHV database contains a host id, but the VM is actually down, the engine will report the following;

- engine.log;

2017-08-31 07:43:23,615+05 INFO  [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (DefaultQuartzScheduler1) [] VM '6be6956f-b8b8-4a33-bb37-30334702b8b9'(cdvpgweb03) is running in db and not running on VDS 'e31634bf-d4a0-47e8-ba81-d49c280acaa3'(dch12bl13.cbec.gov.in)

2017-08-31 07:43:23,623+05 ERROR [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] (DefaultQuartzScheduler1) [] Failed to invoke scheduled method poll: null


- server.log;

2017-08-31 07:43:23,623+05 INFO  [org.quartz.core.JobRunShell] (DefaultQuartzScheduler1) Job DEFAULT.org.ovirt.engine.core.vdsbroker.monitoring.PollVmStatsRefresher.poll#-9223372036854775759 threw a JobExecutionException: : org.quartz.JobExecutionException: failed to execute job



Version-Release number of selected component (if applicable):

RHV 4.1.2
RHVH 7.3 hosts


How reproducible:

100% if you force it to happen.


Steps to Reproduce:
1. Check VM is not running.
2. Set 'run_on_vds' in vm_dynamic to a valid host uuid.
3. Check engine and server logs.


Actual results:


Expected results:


Additional info:

Comment 4 Michal Skrivanek 2017-09-04 09:28:25 EDT

They are not normal either way, but the host was responding, actually.
We should deal with the exception more gracefully, no matter how it happened (it may be restore from a backup)

Comment 5 Michal Skrivanek 2017-09-08 02:17:56 EDT

do we want also a 4.1 backport of https://gerrit.ovirt.org/#/c/81560/ ?

Comment 7 Arik 2017-09-10 12:26:33 EDT

(In reply to Michal Skrivanek from comment #5)
> do we want also a 4.1 backport of https://gerrit.ovirt.org/#/c/81560/ ?

Yes

Comment 13 errata-xmlrpc 2018-05-15 13:43:37 EDT

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2018:1488

Note You need to log in before you can comment on or make changes to this bug.