Bug 826383

Summary:	[mvn] Glossary-push compendium PO file: OutOfMemory for big file
Product:	[Retired] Zanata	Reporter:	Ding-Yi Chen <dchen>
Component:	Component-Maven	Assignee:	Alex Eng <aeng>
Status:	CLOSED CURRENTRELEASE	QA Contact:	Ding-Yi Chen <dchen>
Severity:	medium	Docs Contact:
Priority:	unspecified
Version:	1.6-SNAPSHOT	CC:	sflaniga, zanata-bugs
Target Milestone:	---
Target Release:	1.7
Hardware:	Unspecified
OS:	Linux
Whiteboard:
Fixed In Version:	1.7-SNAPSHOT (20120703-0952)	Doc Type:	Bug Fix
Doc Text:	Cause: Large glossary file causes OutOfMemory during upload. Consequence: Transaction will be canceled as the result of OutOfMemory exception and Transaction time out. Fix: See enhancement in https://bugzilla.redhat.com/show_bug.cgi?id=833653	Story Points:	---
Clone Of:		Environment:
Last Closed:	2012-09-11 05:11:31 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Ding-Yi Chen 2012-05-30 05:59:22 UTC

Version-Release number of selected component (if applicable):
1.6.0-beta-2-SNAPSHOT (20120530-0019)

Steps to Reproduce: 
1. Download the http://i18n.debian.net/compendia/po/zh_TW/compendium-zh_TW-stamp20120529.po
2. Clean up compendium-zh_TW-stamp20120529.po
3. mvn zanata:glossary-push -Dzanata.glossaryFile=compendium-zh_TW-stamp20120529.po -Dzanata.transLang=zh-Hant
 

Actual results: 
Internal error 500

Expected results:
Proceed without error

Comment 4 Alex Eng 2012-06-20 04:32:20 UTC

Fixed in Zanata maven client 1.6.1-SNAPSHOT 

See 

https://github.com/zanata/zanata-client/commit/6ba700d2e1c91e4550671b31fcf9cc19ac34cfe3

https://github.com/zanata/zanata-client/commit/68f31f222e6f161c9fd7eb19140bfe66ab098902

https://github.com/zanata/zanata-client/commit/efe30f0fc607f00f93b71f2c395fd624d1b293cb

https://github.com/zanata/zanata-client/commit/0a3e4d77bcd286ccde10dd705e3566e7a419a9b5

Comment 5 Alex Eng 2012-06-20 22:38:35 UTC

Tested locally with maven client (40M file): 

[INFO] Pushed 99600 of 229163 entries: 1078m21.804s = 17Hours processing.

Comment 6 Ding-Yi Chen 2012-07-03 06:28:12 UTC

VERIFIED with Zanata version 1.7-SNAPSHOT (20120703-0952)