Bug 2005221 - Cluster compatibility version upgrade from 4.5 to 4.6
Summary: Cluster compatibility version upgrade from 4.5 to 4.6
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: ovirt-engine
Classification: oVirt
Component: Database.Core
Version: 4.4.8.5
Hardware: x86_64
OS: Linux
urgent
high
Target Milestone: ovirt-4.4.8-2
: 4.4.8.6
Assignee: Martin Perina
QA Contact: Guilherme Santos
URL:
Whiteboard:
: 2000770 (view as bug list)
Depends On:
Blocks: 2006284
TreeView+ depends on / blocked
 
Reported: 2021-09-17 07:32 UTC by Lorenzo Sartoratti
Modified: 2021-11-10 13:40 UTC (History)
7 users (show)

Fixed In Version: ovirt-engine 4.4.8.6
Doc Type: Release Note
Doc Text:
When oVirt engine is upgraded to 4.4.8 and a user is upgrading a cluster, then VMs time zones are removed and reset to default (UTC). This change is fixing the upgrade script, so users which haven't yet upgraded to 4.4.8 won't be affected by this issue.
Clone Of:
: 2006284 (view as bug list)
Environment:
Last Closed: 2021-09-24 09:20:53 UTC
oVirt Team: Virt
Embargoed:
mperina: ovirt-4.4+


Attachments (Terms of Use)
engine.log (129.11 KB, text/plain)
2021-09-17 14:01 UTC, Lorenzo Sartoratti
no flags Details
new engine log (443.33 KB, text/plain)
2021-09-22 06:04 UTC, Andrei
no flags Details
engine log on 4.4.8.6-1.el8 (449.17 KB, text/plain)
2021-10-08 07:48 UTC, Andrei
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker RHV-43654 0 None None None 2021-09-17 07:35:09 UTC
Red Hat Knowledge Base (Solution) 6352002 0 None None None 2021-09-24 01:29:44 UTC
oVirt gerrit 116833 0 master MERGED core: Fix updating timezones for existing VMs 2021-09-22 13:18:06 UTC
oVirt gerrit 116835 0 ovirt-engine-4.4 MERGED core: Fix updating timezones for existing VMs 2021-09-22 13:48:04 UTC
oVirt gerrit 116836 0 ovirt-engine-4.4.8.z MERGED core: Fix updating timezones for existing VMs 2021-09-22 13:48:12 UTC

Description Lorenzo Sartoratti 2021-09-17 07:32:07 UTC
Hi
we are unable to do the cluster compatibility version upgrade from 4.5 to 4.6 because it can't change the compatibility for the HostedEngine vm:

from engine.log
2021-09-01 15:37:17,271+02 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-5) [28a98510] EVENT_ID: CLUSTER_CANNOT_UPDATE_VM_COMPATIBILITY_VERSION(12,005), Cannot update compatibility version of Vm/Template: [HostedEngine], Message: [No Message]
2021-09-01 15:37:17,457+02 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-5) [28a98510] EVENT_ID: USER_UPDATE_CLUSTER_FAILED(812), Failed to update Host cluster (User: admin@internal-authz)

from web ui:
Error while executing action: Cannot update cluster because the update triggered update of the VMs/Templates and it failed for the following: HostedEngine. To fix the issue, please go to each of them, edit, change the Custom Compatibility Version (or other fields changed previously in the cluster dialog) and press OK. If the save does not pass, fix the dialog validation. After successful cluster update, you can revert your Custom Compatibility Version change (or other changes). If the problem still persists, you may refer to the engine.log file for further details.

Thank you in advance!

Lorenzo

Comment 1 RHEL Program Management 2021-09-17 07:52:08 UTC
The documentation text flag should only be set after 'doc text' field is provided. Please provide the documentation text and set the flag to '?' again.

Comment 2 Martin Perina 2021-09-17 12:35:25 UTC
Could you please provide complete logs from your engine machine gathered by sos-logcollector?

Comment 3 Lorenzo Sartoratti 2021-09-17 13:25:35 UTC
Hi,
could you be more specific in the files to provide? sos-collector collects too much information and even through the clean function I cannot check all sensitive information.
Thanks

Lorenzo

Comment 4 Martin Perina 2021-09-17 13:34:42 UTC
(In reply to Lorenzo Sartoratti from comment #3)
> Hi,
> could you be more specific in the files to provide? sos-collector collects
> too much information and even through the clean function I cannot check all
> sensitive information.
> Thanks
> 
> Lorenzo

We ask for sos-logcollector, because then we can investigate thoroughly what happened.

If you don't want to share all logs, then please share engine.log and server.log and let's see what we can find.

Thanks

Comment 5 Lorenzo Sartoratti 2021-09-17 14:01:30 UTC
Created attachment 1823917 [details]
engine.log

Hi,
steps done:
logrotate -f
launched compatibility update

server.log is an empty file
engine.log non empty file (attaching)

Lorenzo

Comment 6 Martin Perina 2021-09-20 08:06:40 UTC
Please don't use logrotate to rotate logs file generated by WildFly (server.log/engine.log/ui.log under /var/log/ovirt-engine). Doing that you might loose logged data and even WildFly might not work correctly.

To fix that issue I suggest to restart ovirt-engine service.

So anyway if you have any older engine.log files, could you please share them?

Comment 9 Martin Perina 2021-09-21 12:02:07 UTC
*** Bug 2000770 has been marked as a duplicate of this bug. ***

Comment 10 Andrei 2021-09-22 06:04:56 UTC
Created attachment 1825211 [details]
new engine log

Comment 12 Michal Skrivanek 2021-09-22 11:06:30 UTC
this is reverting every VM's TZ to "null" on upgrade (package upgrade) to 4.4.8. 
As a side effect it breaks cluster level update of HE cluster due to timezone field not being updateable, for regular VMs there is just a WARN in logs.

Comment 15 Arik 2021-10-03 10:57:36 UTC
*** Bug 2000770 has been marked as a duplicate of this bug. ***

Comment 16 Andrei 2021-10-08 07:47:56 UTC
Still got same problem 

Curently on 4.4.8.6-1.el8

please check fresh engine log

Comment 17 Andrei 2021-10-08 07:48:45 UTC
Created attachment 1830635 [details]
engine log on 4.4.8.6-1.el8


Note You need to log in before you can comment on or make changes to this bug.