Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1508776

Summary:	UploadImageChunkSizeKB default value is too low, causing low ImageIO performance
Product:	[oVirt] ovirt-engine	Reporter:	Yaniv Kaul <ykaul>
Component:	BLL.Storage	Assignee:	Daniel Erez <derez>
Status:	CLOSED CURRENTRELEASE	QA Contact:	Avihai <aefrat>
Severity:	high	Docs Contact:
Priority:	unspecified
Version:	4.2.0	CC:	amureini, bugs
Target Milestone:	ovirt-4.2.0	Flags:	rule-engine: ovirt-4.2+
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:	The default value of UploadImageChunkSizeKB was increased to 100MB, in order to improve upload speed performance.	Story Points:	---
Clone Of:		Environment:
Last Closed:	2017-12-20 11:06:38 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	Storage	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Yaniv Kaul 2017-11-02 08:33:48 UTC

Description of problem:
With default value of 8192K (8MB), a reasonable 20MBps upload means a new ticket (and the whole process around it) 2.5 times a second or so. This is causing a performance issue. For example, changing to 819200K (800MB) improved performance (on my o-s-t environment, on my laptop!) from 20MBps to 60MBps.

This is probably a short term tweak to improve the upload performance (I think further changes are needed to understand what we can improve here).

Comment 1 Yaniv Kaul 2017-11-02 09:45:34 UTC

*** Bug 1508779 has been marked as a duplicate of this bug. ***

Comment 2 Daniel Erez 2017-11-07 11:00:15 UTC

Increased UploadImageChunkSizeKB to 100MB

Comment 3 Avihai 2017-11-19 09:39:23 UTC

Issue verified.

Engine build:
ovirt-engine-4.2.0-0.0.master.20171114111003.git7aa1b91.el7.centos.noarch

VDSM:
4.20.7-1.gitc9cf1ee

Running the same upload disk test on the same stand (laptop-> engine -> vdsm host) with Increased UploadImageChunkSizeKB to 100MB on engine + new SDK script from my laptop improve the performance by ~22%.

This is persistence for any stand I run with.

Whatever stand I use (physical/Nested) using ISCSI storage domain(XtreamIO) the best time I get to upload a 10G preallocated policy with raw format image takes at best 14min.  

Details on runs made :
I ran on my regular nested (storage-ge-04 environment) with the new script took 14min(~22% better).

~14min which is better than the ~18min-21min we got without the script so there is a major improvement there.

I ran on 4.1 physical stand a manual (via UI) upload of the same 10G image & it took ~19 min - so no real change here between nested & physical engine/VDSMhost.

On a 4.2 physical stand with the newest code via UI it took 22 min.

On a 4.2 physical stand with newest code + new script took 17 min , a 5min improvement(~22% better)  Vs UI.

Comment 4 Sandro Bonazzola 2017-12-20 11:06:38 UTC

This bugzilla is included in oVirt 4.2.0 release, published on Dec 20th 2017.

Since the problem described in this bug report should be
resolved in oVirt 4.2.0 release, published on Dec 20th 2017, it has been closed with a resolution of CURRENT RELEASE.

If the solution does not work for you, please open a new bug report.