Bug 1397833 – [Tracker] - Improve dwh resources consumption

Bugzilla will be upgraded to version 5.0. The upgrade date is tentatively scheduled for 2 December 2018, pending final testing and feedback.

Bug 1397833 - [Tracker] - Improve dwh resources consumption

Summary:	[Tracker] - Improve dwh resources consumption

Status:	CLOSED CURRENTRELEASE

Aliases:	None

Product:	ovirt-distribution
Classification:	oVirt
Component:	Trackers (Show other bugs)
Sub Component:
Version:	---
Hardware:	Unspecified Unspecified

Priority	unspecified Severity high (vote)
Target Milestone:	ovirt-4.1.0-rc
Target Release:	4.1.0
Assigned To:	Shirly Radco
QA Contact:	Lukas Svaty
Docs Contact:

URL:
Whiteboard:
Keywords:	Performance, Tracking

Depends On:
Blocks:	1405114 1408652
	Show dependency tree / graph

Reported:	2016-11-23 07:38 EST by Shirly Radco
Modified:	2017-05-11 05:28 EDT (History)
CC List:	7 users (show)

See Also:
Fixed In Version:
Doc Type:	Enhancement
Doc Text:	Previously, the Java heap size for Data Warehouse was not explicitly set. This resulted in the Java virtual machine using the default size, which could have been as large as a quarter of the machine’s total memory. With this release, Data Warehouse’s configuration was updated to allocate 1 GB of RAM, with the addition of two new parameters: DWH_HEAP_MIN=1g DWH_HEAP_MAX=1g The size can be set to a higher value for larger environments using these new parameters.
Story Points:	---
Clone Of:
Environment:
Last Closed:	2017-03-16 10:49:44 EDT
Type:	Bug
Regression:	---
Mount Type:	---
Documentation:	---
CRM:
Verified Versions:
Category:	---
oVirt Team:	Metrics
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---

Flags:	rule-engine: ovirt‑4.1+ rule-engine: exception+ rule-engine: planning_ack+ rule-engine: devel_ack+ pstehlik: testing_ack+

Attachments	(Terms of Use)
Add an attachment (proposed patch, testcase, etc.)

Groups: None (edit)

Description Shirly Radco 2016-11-23 07:38:43 EST

Description of problem:
DWH is now a dependency of engine. We need to try and improve its resources consumption so it will not impact engine performance.

Comment 1 Lukas Svaty 2016-11-23 07:44:42 EST

Can you provide any additional information what will be contained within this RFE? Should we consider scale environment or just standard setup, clean DWH or under load? 

Can we define here what's the criteria for the RFE? What is the desired result?

Comment 2 Yaniv Kaul 2016-12-01 09:26:07 EST

(In reply to Lukas Svaty from comment #1)
> Can you provide any additional information what will be contained within
> this RFE? Should we consider scale environment or just standard setup, clean
> DWH or under load? 

Essentially running the JVM in a similar manner to how the engine is running (XMS and XMX setting for Java).

> 
> Can we define here what's the criteria for the RFE? What is the desired
> result?

Less (virtual) memory usage, hopefully better CPU utilization. We'll test these on RHEV.TLV (which is using the full mode DWH.

Comment 3 Shirly Radco 2016-12-15 09:27:59 EST

Please test this by adding a new conf file to ovirt-engine-dwhd.conf.d :
DWH_JVM_ARGS="-Xms1g -Xmx1g"

and restart dwh service.

Please how this affects the resources utilization on a scale environment.
Also this should not affect production environment so can be tested on an internal production environment.
It can be tested on a 4.0 environment as well.

Comment 4 Shirly Radco 2016-12-15 11:04:32 EST

Opened separate bug for limiting heap size testing.

Comment 5 Yaniv Kaul 2017-01-15 11:11:00 EST

Shirly - I believe this can be moved to ON_QA now?

Comment 6 Lukas Svaty 2017-03-10 04:08:45 EST

all the dependant bugs in verified moving this as well

Note You need to log in before you can comment on or make changes to this bug.