Bug 835457 - Reindex operation causes java.lang.OutOfMemoryError with large tables
Reindex operation causes java.lang.OutOfMemoryError with large tables
Product: Zanata
Classification: Community
Component: Component-Persistence (Show other bugs)
Unspecified Unspecified
urgent Severity high
: ---
: 1.6.1
Assigned To: David Mason
Ding-Yi Chen
: 828605 (view as bug list)
Depends On:
  Show dependency treegraph
Reported: 2012-06-26 04:26 EDT by David Mason
Modified: 2012-07-18 21:16 EDT (History)
3 users (show)

See Also:
Fixed In Version: 1.6.1-SNAPSHOT (20120702-0014)
Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of:
Last Closed: 2012-07-03 01:27:54 EDT
Type: Bug
Regression: ---
Mount Type: ---
Documentation: ---
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---

Attachments (Terms of Use)

  None (edit)
Description David Mason 2012-06-26 04:26:31 EDT
Description of problem:
When reindexing a table with many rows, a java.lang.OutOfMemoryError occurs and the table is not indexed. Subsequent tables may still be indexed normally.

Version-Release number of selected component (if applicable):

How reproducible:
Depends on size of data and available VM heap space. Approximately 100% of the time with 1,200,000 HTextFlowTargets with 512M of heap, but does not occur with same data when the VM is given 1024M of heap.

Steps to Reproduce:
1.Sign in as an admin user
2.Navigate to search administration page and begin a 'reindex' for one or more tables
3.Look at server log for about 2 minutes
Actual results:
Exception stack traces shown in log, caused by java.lang.OutOfMemoryError
UI shows halted progress bar and message about failed reindex

Expected results:
Reindex completes with no errors

Additional info:
Memory runs out during criteria query, before the indexing loop begins.
Comment 1 David Mason 2012-06-26 23:41:42 EDT
Fixed in 1.6.1-SNAPSHOT

It is still advised to run reindex when server load is minimal, as it will cause increased memory use (for example, in tests with ~1,200,000 HTextFlowTarget, memory usage increased by up to 200M over average usage)

See: https://github.com/zanata/zanata/commit/52720c0509253ba1c75dd380f9f75422769fa6e6
Comment 2 Ding-Yi Chen 2012-07-02 02:41:19 EDT
VERIFIED with Zanata version 1.6.1-SNAPSHOT (20120702-0014)
Zanata version 1.7-SNAPSHOT (20120702-0025)

However, in some cases, I did encounter some "No space left on the device" (Out of disk space"). IMHO, it is not in the scope of this bug. But it should be good to provide some estimation of "recommend disk space for production server".

Should be also in future test plan.
Comment 3 Sean Flanigan 2012-07-03 01:19:33 EDT
*** Bug 828605 has been marked as a duplicate of this bug. ***

Note You need to log in before you can comment on or make changes to this bug.