Bug 1819248

Summary: Cannot upgrade host after engine setup
Product: Red Hat Enterprise Virtualization Manager Reporter: Ivana Saranova <isaranov>
Component: ovirt-engineAssignee: Dana <delfassy>
Status: CLOSED ERRATA QA Contact: Petr Matyáš <pmatyas>
Severity: high Docs Contact:
Priority: high    
Version: 4.4.0CC: cshao, dougsland, lleistne, lsurette, lsvaty, mavital, mperina, mtessun, nlevy, peyu, qiyuan, sbonazzo, shlei, srevivo, weiwang, yaniwang, yturgema
Target Milestone: ovirt-4.4.0   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: rhvm-4.4.0-0.31 ovirt-engine-4.4.0_beta3 rhv-4.4.0-30 Doc Type: No Doc Update
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2020-08-04 13:22:04 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Infra RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1824680, 1824709    

Description Ivana Saranova 2020-03-31 14:36:09 UTC
Description of problem:
After updating engine from ovirt-engine-4.4.0-0.26.master.el8ev.noarch.rpm to ovirt-engine-4.4.0-0.29.master.el8ev.noarch.rpm with engine setup and installing the package for upgrade on its hosts, the hosts cannot be upgraded. Upgrade fails and puts host into InstallFailed state needing reinstall. Engine is not hosted engine.

#host-deploy.log
2020-03-31 16:02:03 CEST - TASK [ovirt-host-deploy-facts : Reset configuration of advanced virtualization module] ***
...
        "msg" : "The conditional check 'host_deploy_origin_type != ovirt_origin_type' failed. The error was: error while evaluating conditional (host_deploy_origin_type != ovirt_origin_type): 'host_deploy_origin_type' is undefined\n\nThe error appears to be in '/usr/share/ovirt-engine/ansible-runner-service-project/project/roles/ovirt-host-deploy-facts/tasks/main.yml': line 12, column 5, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n- block:\n  - name: Reset configuration of advanced virtualization module\n    ^ here\n",

#engine.log
2020-03-31 15:51:38,598+02 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-55) [] EVENT_ID: VDS_FAILURE(12), Host host33 is non responsive.

#this is getting spammed in engine.log
2020-03-31 16:14:50,765+02 INFO  [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to host33-fqdn/host33-ip
2020-03-31 16:14:50,766+02 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-48) [] Unable to RefreshCapabilities: ConnectException: Connection refused
2020-03-31 16:14:50,776+02 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-48) [] Command 'GetCapabilitiesAsyncVDSCommand(HostName = host33, VdsIdAndVdsVDSCommandParametersBase:{hostId='eb4d1d6e-f58f-47d9-8961-bf0da68f6870', vds='Host[host33,eb4d1d6e-f58f-47d9-8961-bf0da68f6870]'})' execution failed: java.net.ConnectException: Connection refused

Version-Release number of selected component (if applicable):
ovirt-engine-4.4.0-0.29.master.el8ev.noarch

How reproducible:
Always

Steps to Reproduce:
1. Update engine to the latest build
2. Upgrade host in admin portal
3. Check that host was successfully upgraded

Actual results:
Host upgrade fails and host is in InstallFailed state.

Expected results:
Host upgrade is successful.

Additional info:

Comment 1 Michal Skrivanek 2020-04-01 13:51:17 UTC
*** Bug 1819514 has been marked as a duplicate of this bug. ***

Comment 2 cshao 2020-04-02 01:23:42 UTC
Failed to register 4.4 host(redhat-virtualization-host-4.4.0-20200330.0.el8_2) to the latest engine (4.4.0-0.29.master.el8ev)

Comment 6 Petr Matyáš 2020-04-16 14:29:21 UTC
Verified on ovirt-engine-4.4.0-0.32.master.el8ev.noarch

This issue did not appear, however upgrade still fails occasionally as per bugs 1824680 and 1824709

Comment 8 errata-xmlrpc 2020-08-04 13:22:04 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Important: RHV Manager (ovirt-engine) 4.4 security, bug fix, and enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2020:3247