Bug 1197902

Summary: [Fedora] Large translated document push times are inconsistent
Product: [Retired] Zanata Reporter: Carlos Munoz <camunoz>
Component: Component-Maven, Performance, Component-zanata-client, Component-zanata-client-ivyAssignee: Patrick Huang <pahuang>
Status: CLOSED CURRENTRELEASE QA Contact: Damian Jansen <djansen>
Severity: high Docs Contact:
Priority: unspecified    
Version: 3.5CC: berrange, djansen, pahuang, zanata-bugs
Target Milestone: ---   
Target Release: 3.6   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: 3.7.0-SNAPSHOT (git-jenkins-zanata-server-github-pull-requests-3056) Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2015-04-20 00:29:47 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---
Bug Depends On:    
Bug Blocks: 1203516    

Description Carlos Munoz 2015-03-02 23:14:37 UTC
Description of problem:
We are seeing some inconsistent times when pushing large translated document files. Specifically when pushing the libvirt project at: 
https://fedora.zanata.org/project/view/libvirt

This is a ~16000 text flow document.

Version-Release number of selected component (if applicable):
3.5


How reproducible:
As more translated documents are pushed in succession, the upload times increase. These times also seem to decrease sharply at points.

Steps to Reproduce:
1. Simply try to push multiple translated documents from this project.

Actual results:


Expected results:


Additional info:

Comment 1 Carlos Munoz 2015-03-02 23:17:10 UTC
Correction: document size is ~8000

Comment 2 Daniel Berrangé 2015-03-03 09:11:48 UTC
FYI for testing you can get the po files easily from here:

  http://libvirt.org/git/?p=libvirt.git;a=tree;f=po;hb=HEAD

If you create a new project in zanata and then try to push the .pot & .po files here, I'd expect you to see the same behaviour that I experiance.

It isn't just a matter of inconsistent push times - it'll often to get to a point where the server simply causes the client to get a fatal error aborting the process.

Comment 3 Patrick Huang 2015-03-17 04:53:16 UTC
On my local machine before the change it looks something like this:
[INFO] Pushing target doc [name=libvirt size=6960 client-locale=de] to server [locale=de]
Done in 9 mins:49 secs
[INFO] Pushing target doc [name=libvirt size=7130 client-locale=ja] to server [locale=ja]
Done in 15 mins:12 secs
[INFO] Pushing target doc [name=libvirt size=3907 client-locale=pl] to server [locale=pl]
Done in 5 mins:45 secs
[INFO] Pushing target doc [name=libvirt size=6873 client-locale=zh-CN] to server [locale=zh-CN]
Done in 20 mins:35 secs
[INFO] Pushing target doc [name=libvirt size=2115 client-locale=it] to server [locale=it]
Done in 2 mins:56 secs
[INFO] Pushing target doc [name=libvirt size=6878 client-locale=es] to server [locale=es]
Done in 26 mins:48 secs
[INFO] Pushing target doc [name=libvirt size=8260 client-locale=uk] to server [locale=uk]
Done in 39 mins:38 secs
[INFO] Pushing target doc [name=libvirt size=2000 client-locale=fr] to server [locale=fr]
Done in 2 mins:59 secs
[INFO] Pushing target doc [name=libvirt size=939 client-locale=sq] to server [locale=sq]
Done in 46 secs


After the change it looks like this:
[INFO] Pushing target doc [name=libvirt size=6960 client-locale=de] to server [locale=de]
Done in 58 secs
[INFO] Pushing target doc [name=libvirt size=7130 client-locale=ja] to server [locale=ja]
Done in 54 secs
[INFO] Pushing target doc [name=libvirt size=3907 client-locale=pl] to server [locale=pl]
Done in 30 secs
[INFO] Pushing target doc [name=libvirt size=6873 client-locale=zh-CN] to server [locale=zh-CN]
Done in 1 mins:4 secs
[INFO] Pushing target doc [name=libvirt size=2115 client-locale=it] to server [locale=it]
Done in 19 secs
[INFO] Pushing target doc [name=libvirt size=6878 client-locale=es] to server [locale=es]
Done in 58 secs
[INFO] Pushing target doc [name=libvirt size=8260 client-locale=uk] to server [locale=uk]
Done in 1 mins:14 secs
[INFO] Pushing target doc [name=libvirt size=2000 client-locale=fr] to server [locale=fr]
Done in 18 secs
[INFO] Pushing target doc [name=libvirt size=939 client-locale=sq] to server [locale=sq]
Done in 10 secs
[INFO] Pushing target doc [name=libvirt size=8141 client-locale=mr] to server [locale=mr]
Done in 1 mins:25 secs
[INFO] Pushing target doc [name=libvirt size=7544 client-locale=ta] to server [locale=ta]
Done in 1 mins:22 secs
[INFO] Pushing target doc [name=libvirt size=6996 client-locale=pt-BR] to server [locale=pt-BR]
Done in 1 mins:16 secs

Comment 4 Patrick Huang 2015-03-17 04:53:50 UTC
https://github.com/zanata/zanata-server/pull/733

Comment 5 Carlos Munoz 2015-03-17 04:58:24 UTC
This should be targeted for a maintenance fix on the 3.6 branch.

Comment 6 Damian Jansen 2015-03-23 06:38:16 UTC
Verified (master) at 0206a8b242d6bfc3a5f63ffae1530930804328c8
Verified (release) at e553261205e458509d3268aa4acb7f2504667777