Bug 833653
| Summary: | Transaction time out when processing large glossary file | ||||||
|---|---|---|---|---|---|---|---|
| Product: | [Retired] Zanata | Reporter: | James Ni <jni> | ||||
| Component: | Performance | Assignee: | Alex Eng <aeng> | ||||
| Status: | CLOSED CURRENTRELEASE | QA Contact: | Ding-Yi Chen <dchen> | ||||
| Severity: | high | Docs Contact: | |||||
| Priority: | unspecified | ||||||
| Version: | 1.6-SNAPSHOT | CC: | aeng, zanata-bugs | ||||
| Target Milestone: | --- | ||||||
| Target Release: | 1.7 | ||||||
| Hardware: | Unspecified | ||||||
| OS: | Unspecified | ||||||
| Whiteboard: | |||||||
| Fixed In Version: | Doc Type: | Enhancement | |||||
| Doc Text: |
Feature:
Allow users to specify batch size for processing during glossary upload. Default size = 50
Reason:
To eliminate transaction time out when processing large glossary file.
|
Story Points: | --- | ||||
| Clone Of: | Environment: | ||||||
| Last Closed: | 2012-09-11 05:11:25 UTC | Type: | Bug | ||||
| Regression: | --- | Mount Type: | --- | ||||
| Documentation: | --- | CRM: | |||||
| Verified Versions: | Category: | --- | |||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||
| Embargoed: | |||||||
| Bug Depends On: | 826821 | ||||||
| Bug Blocks: | |||||||
| Attachments: |
|
||||||
Implemented batch transaction on server side. See https://github.com/zanata/zanata/commit/0136107b2c9bbd76bb34ae16c9cfca8e3c364505 This fix works for 1.7 Servers but not 1.6.1 servers. Reassigned. After talked to Alex, The server side fix will only go to 1.7. As for 1.6 servers, workaround can be applied to client. |
Created attachment 593119 [details] part of log to show the traceback of error Description of problem: Transaction on server is time out due to processing this large file. How reproducible: Steps to Reproduce: 1. Using zanata python client to push compendium glossary file to server zanata-empire.lab.eng.bne.redhat.com 2. Download compendium-zh_CN-LATEST.po and clean up 3. run zanata glossary push --lang zh-Hans compendium-zh_CN-LATEST.po Actual results: The Client receive 500 error from server: The server encountered an internal error () that prevented it from fulfilling this request. Expected results: 200 Success response from server Additional info: Actually, the Transaction on server is time out due to processing this large file, the attatchment is part of the log of server, it shows that server indeed receive the glossary items from client and store them to database, but since there are a huge amount of glossary items, the server failed at the end since timeout is set to 300s for Transaction. I think maybe no need to change the Transaction timeout setting on server, but on the other hand, try to break the large file to small part on client and then push to server.