Bug 1709015 - HE deployment fail with 'Not enough memory' when given the engine vm the maximum memory
Summary: HE deployment fail with 'Not enough memory' when given the engine vm the maxi...
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: cockpit-ovirt
Classification: oVirt
Component: Hosted Engine
Version: 0.12.8
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ovirt-4.3.5
: 0.12.9
Assignee: Ido Rosenzwig
QA Contact: Wei Wang
URL:
Whiteboard:
Depends On:
Blocks: 1709938
TreeView+ depends on / blocked
 
Reported: 2019-05-12 14:34 UTC by Ido Rosenzwig
Modified: 2019-07-30 14:08 UTC (History)
11 users (show)

Fixed In Version: cockpit-ovirt-0.12.9
Clone Of:
: 1709938 (view as bug list)
Environment:
Last Closed: 2019-07-30 14:08:06 UTC
oVirt Team: Integration
Embargoed:
sbonazzo: ovirt-4.3?
cshao: testing_plan_complete?
sbonazzo: planning_ack?
sbonazzo: devel_ack+
weiwang: testing_ack+


Attachments (Terms of Use)
log files (540.50 KB, application/gzip)
2019-05-17 10:28 UTC, Wei Wang
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Github oVirt ovirt-ansible-hosted-engine-setup pull 191 0 None closed Add small amount of memory to the total available memory 2020-07-16 15:59:17 UTC
Github oVirt ovirt-ansible-hosted-engine-setup pull 198 0 None closed Add more memory for the grace memory amount 2020-07-16 15:59:16 UTC
oVirt gerrit 99932 0 master MERGED Reserve small amount of memory for the host during deployment 2020-07-16 15:59:16 UTC
oVirt gerrit 99941 0 ovirt-4.3 MERGED Reserve small amount of memory for the host during deployment 2020-07-16 15:59:16 UTC

Description Ido Rosenzwig 2019-05-12 14:34:50 UTC
This bug was initially created as a copy of Bug #1704323

I am copying this bug because: 



Description of problem:
When deploying HE and giving the engine vm the max available memory it is sometimes fails with the following error because the system is using a little bit of the memory that was supposed to be assigned to the engine vm.

[ INFO  ] TASK [ovirt.hosted_engine_setup : Fail if user chose more memory then the available memory]
[ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "Not enough memory: 4351MB, while only 4343MB are available on the host"}
[ ERROR ] Failed to execute stage 'Closing up': Failed executing ansible-playbook

Version-Release number of selected component (if applicable):


How reproducible:
Sometimes - not always

Steps to Reproduce:
1. deploy hosted-engine
2. give the max available memory - the default
3.

Actual results:
deployment fail (sometimes)

Expected results:
deployment succeed

Additional info:
-

Comment 1 Wei Wang 2019-05-14 02:55:49 UTC
Test Version
rhvh-4.3.0.6-0.20190418.0+1
cockpit-dashboard-176-4.el7.x86_64
cockpit-bridge-176-4.el7.x86_64
cockpit-storaged-176-4.el7.noarch
cockpit-176-4.el7.x86_64
cockpit-system-176-4.el7.noarch
cockpit-ws-176-4.el7.x86_64
cockpit-machines-ovirt-176-4.el7.noarch
cockpit-ovirt-dashboard-0.12.8-1.el7ev.noarch
ovirt-hosted-engine-ha-2.3.1-1.el7ev.noarch
ovirt-hosted-engine-setup-2.3.7-1.el7ev.noarch

Test Steps:
1. Clean install rhvh-4.3.0.6-0.20190418.0
2. deploy hosted-engine
   a: via cockpit UI
   b: via CLI

3. Set the max available memory

Result:
a. For cockpit UI, QE cannot reproduce this issue after trying 5 times
b. For CLI, QE cannot reproduce this issue after trying 5 times

So QE cannot reproduce this issue, maybe I missing some key steps? Could you please give me some points? thanks!

Comment 2 Ido Rosenzwig 2019-05-14 06:08:22 UTC
as I mentioned, it happens sometimes.
On the CLI no amount of memory was reserved for the host while on cockpit we reserved in the past 256MB.
Thus, it is more likely that you will succeed reproducing it via CLI and not via cockpit UI.

The Fix was to reserve 512MB on the host. That's why we have a patch in cockpit-ovirt too.

Comment 3 Wei Wang 2019-05-17 10:26:28 UTC
Test Version
RHVH-4.3-20190516.1-RHVH-x86_64-dvd1.iso
cockpit-ovirt-dashboard-0.12.9-1.el7ev.noarch
ovirt-hosted-engine-setup-2.3.8-1.el7ev.noarch
ovirt-hosted-engine-ha-2.3.1-1.el7ev.noarch

Test Steps:
1. Clean install RHVH-4.3-20190516.1-RHVH-x86_64-dvd1.iso
2. Deploy hosted-engine via CLI
3. Set the max available memory(Get from cockpit wizard)


Result:
1. Deploy failed
[ INFO  ] TASK [ovirt.hosted_engine_setup : Fail if user chose more memory then the available memory]
[ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "Not enough memory! 62893MB, while only 62738MB are available on the host. Be aware that 512MB is reserved for the host and cannot be allocated to the engine VM."}
[ ERROR ] Failed to execute stage 'Closing up': Failed executing ansible-playbook

QE can reproduce this bug, change the status to "ASSIGNED"

Comment 4 Wei Wang 2019-05-17 10:28:46 UTC
Created attachment 1570016 [details]
log files

Comment 5 Ido Rosenzwig 2019-05-19 06:42:02 UTC
This problem was fixed in https://github.com/oVirt/ovirt-ansible-hosted-engine-setup/pull/191

Please verify again.

Comment 6 Wei Wang 2019-05-20 10:03:00 UTC
I will retest it when I get the new build.

Comment 7 Wei Wang 2019-05-23 12:57:55 UTC
Test Version
RHVH-4.3-20190523.0-RHVH-x86_64-dvd1.iso
cockpit-ovirt-dashboard-0.13.0-1.el7ev.noarch

Test steps:
According to comment 3

Result:
Deploy failed
[ INFO  ] TASK [ovirt.hosted_engine_setup : Fail if user chose more memory then the available memory]
[ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "Not enough memory! 62891MB, while only 62788MB are available on the host. Be aware that 512MB is reserved for the host and cannot be allocated to the engine VM."}
[ ERROR ] Failed to execute stage 'Closing up': Failed executing ansible-playbook
[ INFO  ] Stage: Clean up


Move bug status to "ASSIGNED"

Comment 8 Wei Wang 2019-06-17 03:11:57 UTC
QE will verify it until getting new build.

Comment 9 Wei Wang 2019-06-21 11:13:23 UTC
Test Version
RHVH-4.3-20190620.7-RHVH-x86_64-dvd1.iso
cockpit-system-195-1.el7.noarch
cockpit-195-1.el7.x86_64
cockpit-bridge-195-1.el7.x86_64
cockpit-ws-195-1.el7.x86_64
cockpit-machines-ovirt-195-1.el7.noarch
cockpit-dashboard-195-1.el7.x86_64
cockpit-storaged-195-1.el7.noarch
cockpit-ovirt-dashboard-0.13.2-2.el7ev.noarch

Test Steps:
According to comment 7

Result:
Hosted engine deploys successfully

bug is fixed, verified.

Comment 10 Sandro Bonazzola 2019-07-30 14:08:06 UTC
This bugzilla is included in oVirt 4.3.5 release, published on July 30th 2019.

Since the problem described in this bug report should be
resolved in oVirt 4.3.5 release, it has been closed with a resolution of CURRENT RELEASE.

If the solution does not work for you, please open a new bug report.


Note You need to log in before you can comment on or make changes to this bug.