Description of problem: When upgrading hosted engine host the engine first moves it to "Maintenance" mode which puts the host in "local maintenance". After upgrade the host status is changed to "Up" in the engine but remains "local maintenance" in the host. How reproducible: 100% Steps to Reproduce: 1. Have a hosted engine host in "Up" status that has available upgrades. 2. Click on the upgrade button. Wait for the operation to finish. Actual results: The host is marked as "Up" in the UI but in reality remains in "local maintenance". "/var/lib/ovirt-hosted-engine-ha/ha.conf" appears with "local_maintenance=True" and "hosted-engine --vm-status" shows "maintenance=True". Expected results: The host is marked as "Up" in the UI, "/var/lib/ovirt-hosted-engine-ha/ha.conf" appears with "local_maintenance=False" and and "hosted-engine --vm-status" shows "maintenance=False".
I think that this bug is a duplicate of https://bugzilla.redhat.com/show_bug.cgi?id=1353600, Please consider closing it as a dup.
This is a similar but different bug with a fix in a different product. It was opened as a result from playing around while fixing https://bugzilla.redhat.com/show_bug.cgi?id=1353600.
Host being up and not being HA-available is OK from the perspective of regular guest-VMs. We don't have limitation for hosted-engine hosts to get none operational status in case that they don't receive positive score of 3400 or can't connect to HE storage. BTW there is always a work around, you can run "hosted-engine --set-maintenance --mode=none" on host that remains in local maintenance.
In this case it was the engine that caused the host to go to local maintenance mode (for upgrade), and so it should be the engine that reverts it back to "local maintenance mode = none".
*** Bug 1374593 has been marked as a duplicate of this bug. ***
*** Bug 1377172 has been marked as a duplicate of this bug. ***
Should be working now, forth to https://bugzilla.redhat.com/show_bug.cgi?id=1353600. I'll try the reproduction steps of this very bug to verify it later.
(In reply to Jenny Tokar from comment #0) > Description of problem: > When upgrading hosted engine host the engine first moves it to "Maintenance" > mode which puts the host in "local maintenance". After upgrade the host > status is changed to "Up" in the engine but remains "local maintenance" in > the host. > > > How reproducible: > 100% > > Steps to Reproduce: > 1. Have a hosted engine host in "Up" status that has available upgrades. > 2. Click on the upgrade button. Wait for the operation to finish. > > Actual results: > The host is marked as "Up" in the UI but in reality remains in "local > maintenance". "/var/lib/ovirt-hosted-engine-ha/ha.conf" appears with > "local_maintenance=True" and "hosted-engine --vm-status" shows > "maintenance=True". > > Expected results: > The host is marked as "Up" in the UI, > "/var/lib/ovirt-hosted-engine-ha/ha.conf" appears with > "local_maintenance=False" and and "hosted-engine --vm-status" shows > "maintenance=False". Is this a RHEVH specific?
After we've discussed the issue, there is no relation to RHEVH only case here. Works for me on these components on hosts: rhev-release-4.0.5-6-001.noarch sanlock-3.2.4-3.el7_2.x86_64 ovirt-setup-lib-1.0.2-1.el7ev.noarch ovirt-vmconsole-host-1.0.4-1.el7ev.noarch vdsm-4.18.15.2-1.el7ev.x86_64 libvirt-client-1.2.17-13.el7_2.6.x86_64 ovirt-hosted-engine-ha-2.0.4-1.el7ev.noarch ovirt-imageio-common-0.3.0-0.el7ev.noarch qemu-kvm-rhev-2.3.0-31.el7_2.23.x86_64 ovirt-hosted-engine-setup-2.0.3-2.el7ev.noarch ovirt-host-deploy-1.5.3-1.el7ev.noarch ovirt-engine-sdk-python-3.6.9.1-1.el7ev.noarch ovirt-imageio-daemon-0.4.0-0.el7ev.noarch ovirt-vmconsole-1.0.4-1.el7ev.noarch mom-0.5.8-1.el7ev.noarch Linux version 3.10.0-327.44.1.el7.x86_64 (mockbuild.eng.bos.redhat.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-4) (GCC) ) #1 SMP Wed Nov 2 03:25:28 EDT 2016 Linux 3.10.0-327.44.1.el7.x86_64 #1 SMP Wed Nov 2 03:25:28 EDT 2016 x86_64 x86_64 x86_64 GNU/Linux Red Hat Enterprise Linux Server release 7.2 (Maipo) On engine: rhevm-spice-client-x64-msi-4.0-3.el7ev.noarch rhevm-branding-rhev-4.0.0-5.el7ev.noarch rhevm-dependencies-4.0.0-1.el7ev.noarch rhevm-spice-client-x86-msi-4.0-3.el7ev.noarch rhevm-guest-agent-common-1.0.12-3.el7ev.noarch rhevm-setup-plugins-4.0.0.3-1.el7ev.noarch rhevm-doc-4.0.5-1.el7ev.noarch rhevm-4.0.5.5-0.1.el7ev.noarch ovirt-engine-userportal-4.0.5.5-0.1.el7ev.noarch ovirt-engine-dwh-4.0.5-1.el7ev.noarch ovirt-imageio-proxy-0.4.0-0.el7ev.noarch ovirt-engine-webadmin-portal-4.0.5.5-0.1.el7ev.noarch ovirt-engine-sdk-python-3.6.9.1-1.el7ev.noarch ovirt-engine-dwh-setup-4.0.5-1.el7ev.noarch ovirt-vmconsole-proxy-1.0.4-1.el7ev.noarch ovirt-setup-lib-1.0.2-1.el7ev.noarch ovirt-imageio-common-0.4.0-0.el7ev.noarch ovirt-engine-extension-aaa-jdbc-1.1.1-1.el7ev.noarch ovirt-engine-dashboard-1.0.5-1.el7ev.x86_64 ovirt-engine-4.0.5.5-0.1.el7ev.noarch ovirt-vmconsole-1.0.4-1.el7ev.noarch ovirt-image-uploader-4.0.1-1.el7ev.noarch ovirt-host-deploy-java-1.5.3-1.el7ev.noarch ovirt-engine-vmconsole-proxy-helper-4.0.5.5-0.1.el7ev.noarch ovirt-engine-extensions-api-impl-4.0.5.5-0.1.el7ev.noarch ovirt-engine-setup-base-4.0.5.5-0.1.el7ev.noarch ovirt-engine-setup-plugin-vmconsole-proxy-helper-4.0.5.5-0.1.el7ev.noarch python-ovirt-engine-sdk4-4.0.2-1.el7ev.x86_64 ovirt-engine-tools-backup-4.0.5.5-0.1.el7ev.noarch ovirt-engine-restapi-4.0.5.5-0.1.el7ev.noarch ovirt-engine-backend-4.0.5.5-0.1.el7ev.noarch ovirt-log-collector-4.0.1-1.el7ev.noarch ovirt-engine-setup-4.0.5.5-0.1.el7ev.noarch ovirt-engine-lib-4.0.5.5-0.1.el7ev.noarch ovirt-engine-setup-plugin-ovirt-engine-common-4.0.5.5-0.1.el7ev.noarch ovirt-engine-setup-plugin-ovirt-engine-4.0.5.5-0.1.el7ev.noarch ovirt-host-deploy-1.5.3-1.el7ev.noarch ovirt-imageio-proxy-setup-0.4.0-0.el7ev.noarch ovirt-engine-tools-4.0.5.5-0.1.el7ev.noarch ovirt-engine-cli-3.6.8.1-1.el7ev.noarch ovirt-engine-setup-plugin-websocket-proxy-4.0.5.5-0.1.el7ev.noarch ovirt-iso-uploader-4.0.2-1.el7ev.noarch ovirt-engine-websocket-proxy-4.0.5.5-0.1.el7ev.noarch ovirt-engine-dbscripts-4.0.5.5-0.1.el7ev.noarch Linux version 3.10.0-327.36.1.el7.x86_64 (mockbuild.eng.bos.redhat.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-4) (GCC) ) #1 SMP Wed Aug 17 03:02:37 EDT 2016 Linux 3.10.0-327.36.1.el7.x86_64 #1 SMP Wed Aug 17 03:02:37 EDT 2016 x86_64 x86_64 x86_64 GNU/Linux Red Hat Enterprise Linux Server release 7.2 (Maipo) I've seen an upgrade symbol which appeared on one of two hosts and I've selected that host with running HE VM on it and pressed on upgrade button. I've received this warning from the engine and accepted it with OK button: "Upgrade Host There are running VMs on this host. Are you sure you want to continue the upgrade process? Running VM(s) will be migrated to another host." Once HE VM migrated away from host, the host got in to the maintenance status, upgraded and then automatically turned back to active. I've checked upgraded host's score and found that it was 3400, as it should and host was active. Moving this bug to verified.