Bug 2006284 - Cluster compatibility version upgrade from 4.5 to 4.6
Summary: Cluster compatibility version upgrade from 4.5 to 4.6
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Enterprise Virtualization Manager
Classification: Red Hat
Component: ovirt-engine
Version: 4.4.8
Hardware: x86_64
OS: Linux
urgent
urgent
Target Milestone: ovirt-4.4.8-2
: ---
Assignee: Arik
QA Contact: meital avital
URL:
Whiteboard:
Depends On: 2005221
Blocks:
TreeView+ depends on / blocked
 
Reported: 2021-09-21 11:49 UTC by Martin Perina
Modified: 2022-12-07 15:28 UTC (History)
13 users (show)

Fixed In Version:
Doc Type: Release Note
Doc Text:
When RHV Manager is upgraded to 4.4.8 and a user is upgrading cluster, then VMs time zones are removed and reset to default (UTC). This change is fixing the upgrade script, so users which haven't yet upgraded to 4.4.8 won't be affected by this issue.
Clone Of: 2005221
Environment:
Last Closed: 2021-09-23 15:49:50 UTC
oVirt Team: Virt
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker RHV-43688 0 None None None 2021-09-21 11:59:44 UTC
Red Hat Knowledge Base (Solution) 6350452 0 None None None 2021-09-22 17:22:22 UTC
Red Hat Knowledge Base (Solution) 6352002 0 None None None 2021-09-24 01:29:57 UTC
Red Hat Product Errata RHBA-2021:3655 0 None None None 2021-09-23 15:49:51 UTC
oVirt gerrit 116833 0 master MERGED core: Fix updating timezones for existing VMs 2021-09-22 13:18:07 UTC
oVirt gerrit 116835 0 ovirt-engine-4.4 MERGED core: Fix updating timezones for existing VMs 2021-09-22 13:48:04 UTC
oVirt gerrit 116836 0 ovirt-engine-4.4.8.z MERGED core: Fix updating timezones for existing VMs 2021-09-22 13:48:12 UTC

Description Martin Perina 2021-09-21 11:49:49 UTC
+++ This bug was initially created as a clone of Bug #2005221 +++

Hi
we are unable to do the cluster compatibility version upgrade from 4.5 to 4.6 because it can't change the compatibility for the HostedEngine vm:

from engine.log
2021-09-01 15:37:17,271+02 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-5) [28a98510] EVENT_ID: CLUSTER_CANNOT_UPDATE_VM_COMPATIBILITY_VERSION(12,005), Cannot update compatibility version of Vm/Template: [HostedEngine], Message: [No Message]
2021-09-01 15:37:17,457+02 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-5) [28a98510] EVENT_ID: USER_UPDATE_CLUSTER_FAILED(812), Failed to update Host cluster (User: admin@internal-authz)

from web ui:
Error while executing action: Cannot update cluster because the update triggered update of the VMs/Templates and it failed for the following: HostedEngine. To fix the issue, please go to each of them, edit, change the Custom Compatibility Version (or other fields changed previously in the cluster dialog) and press OK. If the save does not pass, fix the dialog validation. After successful cluster update, you can revert your Custom Compatibility Version change (or other changes). If the problem still persists, you may refer to the engine.log file for further details.

Thank you in advance!

Lorenzo

--- Additional comment from RHEL Program Management on 2021-09-17 09:52:08 CEST ---

The documentation text flag should only be set after 'doc text' field is provided. Please provide the documentation text and set the flag to '?' again.

--- Additional comment from Martin Perina on 2021-09-17 14:35:25 CEST ---

Could you please provide complete logs from your engine machine gathered by sos-logcollector?

--- Additional comment from Lorenzo Sartoratti on 2021-09-17 15:25:35 CEST ---

Hi,
could you be more specific in the files to provide? sos-collector collects too much information and even through the clean function I cannot check all sensitive information.
Thanks

Lorenzo

--- Additional comment from Martin Perina on 2021-09-17 15:34:42 CEST ---

(In reply to Lorenzo Sartoratti from comment #3)
> Hi,
> could you be more specific in the files to provide? sos-collector collects
> too much information and even through the clean function I cannot check all
> sensitive information.
> Thanks
> 
> Lorenzo

We ask for sos-logcollector, because then we can investigate thoroughly what happened.

If you don't want to share all logs, then please share engine.log and server.log and let's see what we can find.

Thanks

--- Additional comment from Lorenzo Sartoratti on 2021-09-17 16:01:30 CEST ---

Hi,
steps done:
logrotate -f
launched compatibility update

server.log is an empty file
engine.log non empty file (attaching)

Lorenzo

--- Additional comment from Martin Perina on 2021-09-20 10:06:40 CEST ---

Please don't use logrotate to rotate logs file generated by WildFly (server.log/engine.log/ui.log under /var/log/ovirt-engine). Doing that you might loose logged data and even WildFly might not work correctly.

To fix that issue I suggest to restart ovirt-engine service.

So anyway if you have any older engine.log files, could you please share them?

--- Additional comment from Fabio Futigami on 2021-09-20 16:24:01 CEST ---

Hi, I have a customer from case 03036833 with the same issue. It seems we have all the logs (engine.log and server.log). Is there anything we can provide to assist in this bugzilla?

Comment 9 Wei Wang 2021-09-23 13:24:58 UTC
This bug is verified pass. My steps are as below:

1. Host A: Install RHVH 4.4.7 build (rhvh-4.4.7.4-0.20210812.0) and deploy hosted engine with rhvm-appliance-4.4-20210715.0.el8ev.rpm, 
2. Host B: Install the same RHVH 4.4.7 build
3. Create DC and Cluster which chosen 4.5 in the vm engine, add host B to the engine
4. Create multiple entities with different timezones (3 VMs, 2 pools, 2 templates)
5. Check & note engine DB entries for timezone for those entities

               vm_guid                |   vm_name    |      time_zone      
--------------------------------------+--------------+---------------------
 00000003-0003-0003-0003-0000000000be | Tiny         | Etc/GMT
 00000005-0005-0005-0005-0000000002e6 | Small        | Etc/GMT
 00000009-0009-0009-0009-0000000000f1 | Large        | Etc/GMT
 0000000b-000b-000b-000b-00000000021f | XLarge       | Etc/GMT
 00000007-0007-0007-0007-00000000010a | Medium       | Etc/GMT
 028ce457-b94e-4095-a8a3-5d922a6ceb2e | template_1   | Pacific/Honolulu
 00000000-0000-0000-0000-000000000000 | Blank        | 
 76f8b1a2-7376-4630-823b-3c66e58be5e9 | HostedEngine | Etc/GMT
 4d1d0a6b-0b95-41d9-a0ef-8f21de10d86e | template_2   | America/Anchorage
 e1f3a2c4-ee74-426c-9546-f254dee1a323 | vm_2         | Atlantic/Azores
 ed371952-e267-40be-a851-2218c5d375df | vm_1         | Pacific/Apia
 f4df9c2e-65c2-424f-a7be-75e946791702 | pool_2-1     | America/Regina
 01444a9a-a5a2-4167-b177-e70c04279b48 | pool_1-1     | America/Los_Angeles
 c769a8e2-85ea-4fb1-a1e6-9da3ed488a1e | vm_3         | America/Denver

6. Copy below repos to engine's /etc/yum.repo.d/
   http://bob.eng.lab.tlv.redhat.com/builds/4.4/rhv-4.4.8-8/api/rhel_84_engine_x86.repo
   http://bob.eng.lab.tlv.redhat.com/builds/4.4/rhv-4.4.8-8/api/rhv_44_engine.repo
7. yum update and reboot it.
8. yum install http://bob.eng.lab.tlv.redhat.com/builds/4.4/rhv-4.4.8-8/rhv-release-engine-4.4.8-8-001.noarch.rpm
9  Run engine-setup to upgrade engine.
10. Log in to the engine and shutdown all the related vms
11. Change the cluster compatibility level of the cluster to 4.6
12. Check entries for timezone for those entities in DB and UI

               vm_guid                |   vm_name    |      time_zone      
--------------------------------------+--------------+---------------------
 00000003-0003-0003-0003-0000000000be | Tiny         | Etc/GMT
 00000005-0005-0005-0005-0000000002e6 | Small        | Etc/GMT
 00000009-0009-0009-0009-0000000000f1 | Large        | Etc/GMT
 0000000b-000b-000b-000b-00000000021f | XLarge       | Etc/GMT
 00000007-0007-0007-0007-00000000010a | Medium       | Etc/GMT
 76f8b1a2-7376-4630-823b-3c66e58be5e9 | HostedEngine | Etc/GMT
 00000000-0000-0000-0000-000000000000 | Blank        | 
 028ce457-b94e-4095-a8a3-5d922a6ceb2e | template_1   | Pacific/Honolulu
 4d1d0a6b-0b95-41d9-a0ef-8f21de10d86e | template_2   | America/Anchorage
 01444a9a-a5a2-4167-b177-e70c04279b48 | pool_1-1     | America/Los_Angeles
 ed371952-e267-40be-a851-2218c5d375df | vm_1         | Pacific/Apia
 f4df9c2e-65c2-424f-a7be-75e946791702 | pool_2-1     | America/Regina
 c769a8e2-85ea-4fb1-a1e6-9da3ed488a1e | vm_3         | America/Denver
 e1f3a2c4-ee74-426c-9546-f254dee1a323 | vm_2         | Atlantic/Azores

The entries for timezone for those entities are unchanged into default one in DB and UI

13. Check engine, vdsm logs, message no time drift.

Move it to "VERIFIED"

Comment 11 errata-xmlrpc 2021-09-23 15:49:50 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (RHV Manager (ovirt-engine) [ovirt-4.4.8] [async]), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:3655


Note You need to log in before you can comment on or make changes to this bug.