Bug 2005221

Summary: Cluster compatibility version upgrade from 4.5 to 4.6
Product: [oVirt] ovirt-engine Reporter: Lorenzo Sartoratti <lorenzo.sartoratti>
Component: Database.CoreAssignee: Martin Perina <mperina>
Status: CLOSED CURRENTRELEASE QA Contact: Guilherme Santos <gdeolive>
Severity: high Docs Contact:
Priority: urgent    
Version: 4.4.8.5CC: ahadas, arusakov, bugs, ffutigam, michal.skrivanek, mkalinin, mperina
Target Milestone: ovirt-4.4.8-2Keywords: ZStream
Target Release: 4.4.8.6Flags: mperina: ovirt-4.4+
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: ovirt-engine 4.4.8.6 Doc Type: Release Note
Doc Text:
When oVirt engine is upgraded to 4.4.8 and a user is upgrading a cluster, then VMs time zones are removed and reset to default (UTC). This change is fixing the upgrade script, so users which haven't yet upgraded to 4.4.8 won't be affected by this issue.
Story Points: ---
Clone Of:
: 2006284 (view as bug list) Environment:
Last Closed: 2021-09-24 09:20:53 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Virt RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 2006284    
Attachments:
Description Flags
engine.log
none
new engine log
none
engine log on 4.4.8.6-1.el8 none

Description Lorenzo Sartoratti 2021-09-17 07:32:07 UTC
Hi
we are unable to do the cluster compatibility version upgrade from 4.5 to 4.6 because it can't change the compatibility for the HostedEngine vm:

from engine.log
2021-09-01 15:37:17,271+02 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-5) [28a98510] EVENT_ID: CLUSTER_CANNOT_UPDATE_VM_COMPATIBILITY_VERSION(12,005), Cannot update compatibility version of Vm/Template: [HostedEngine], Message: [No Message]
2021-09-01 15:37:17,457+02 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-5) [28a98510] EVENT_ID: USER_UPDATE_CLUSTER_FAILED(812), Failed to update Host cluster (User: admin@internal-authz)

from web ui:
Error while executing action: Cannot update cluster because the update triggered update of the VMs/Templates and it failed for the following: HostedEngine. To fix the issue, please go to each of them, edit, change the Custom Compatibility Version (or other fields changed previously in the cluster dialog) and press OK. If the save does not pass, fix the dialog validation. After successful cluster update, you can revert your Custom Compatibility Version change (or other changes). If the problem still persists, you may refer to the engine.log file for further details.

Thank you in advance!

Lorenzo

Comment 1 RHEL Program Management 2021-09-17 07:52:08 UTC
The documentation text flag should only be set after 'doc text' field is provided. Please provide the documentation text and set the flag to '?' again.

Comment 2 Martin Perina 2021-09-17 12:35:25 UTC
Could you please provide complete logs from your engine machine gathered by sos-logcollector?

Comment 3 Lorenzo Sartoratti 2021-09-17 13:25:35 UTC
Hi,
could you be more specific in the files to provide? sos-collector collects too much information and even through the clean function I cannot check all sensitive information.
Thanks

Lorenzo

Comment 4 Martin Perina 2021-09-17 13:34:42 UTC
(In reply to Lorenzo Sartoratti from comment #3)
> Hi,
> could you be more specific in the files to provide? sos-collector collects
> too much information and even through the clean function I cannot check all
> sensitive information.
> Thanks
> 
> Lorenzo

We ask for sos-logcollector, because then we can investigate thoroughly what happened.

If you don't want to share all logs, then please share engine.log and server.log and let's see what we can find.

Thanks

Comment 5 Lorenzo Sartoratti 2021-09-17 14:01:30 UTC
Created attachment 1823917 [details]
engine.log

Hi,
steps done:
logrotate -f
launched compatibility update

server.log is an empty file
engine.log non empty file (attaching)

Lorenzo

Comment 6 Martin Perina 2021-09-20 08:06:40 UTC
Please don't use logrotate to rotate logs file generated by WildFly (server.log/engine.log/ui.log under /var/log/ovirt-engine). Doing that you might loose logged data and even WildFly might not work correctly.

To fix that issue I suggest to restart ovirt-engine service.

So anyway if you have any older engine.log files, could you please share them?

Comment 9 Martin Perina 2021-09-21 12:02:07 UTC
*** Bug 2000770 has been marked as a duplicate of this bug. ***

Comment 10 Andrei 2021-09-22 06:04:56 UTC
Created attachment 1825211 [details]
new engine log

Comment 12 Michal Skrivanek 2021-09-22 11:06:30 UTC
this is reverting every VM's TZ to "null" on upgrade (package upgrade) to 4.4.8. 
As a side effect it breaks cluster level update of HE cluster due to timezone field not being updateable, for regular VMs there is just a WARN in logs.

Comment 15 Arik 2021-10-03 10:57:36 UTC
*** Bug 2000770 has been marked as a duplicate of this bug. ***

Comment 16 Andrei 2021-10-08 07:47:56 UTC
Still got same problem 

Curently on 4.4.8.6-1.el8

please check fresh engine log

Comment 17 Andrei 2021-10-08 07:48:45 UTC
Created attachment 1830635 [details]
engine log on 4.4.8.6-1.el8