Bug 781057 (SOA-3543)

Summary: VDB deployment in EDS can be extremely slow based upon indexing needs
Product: [JBoss] JBoss Enterprise SOA Platform 5 Reporter: jolee
Component: EDSAssignee: Van Halbert <vhalbert>
Status: CLOSED NEXTRELEASE QA Contact:
Severity: high Docs Contact:
Priority: high    
Version: 5.1.0 GACC: jolee
Target Milestone: ---   
Target Release: 5.3.0 GA   
Hardware: Unspecified   
OS: Unspecified   
URL: http://jira.jboss.org/jira/browse/SOA-3543
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
JBoss Enterprise Data Services Platform 5.1.0
Last Closed: 2011-11-11 04:45:53 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Bug Depends On:    
Bug Blocks: 781058    

Description jolee 2011-11-01 16:33:08 UTC
Help Desk Ticket Reference: https://na7.salesforce.com/500A0000008SHwx
Steps to Reproduce: Deploying a VDB w/a large amount of schemas will expose this problem.  It is extremely apparent when deploying to Solaris systems in particular.
project_key: SOA

Problem:
The index metadata loading logic is not well optimized. In short, each time a call to IndexMetadataFactory.queryIndex is made the blocks are fully scanned.  For small VDBs there isn't much of an issue because of the block caching logic, but during a vdb deploy we could be constantly re-reading data from the files.

Possible solution:
The IndexMetadataFactory loading strategy should be made aware of the index file per schema strategy so that scans can be made per schema rather than against all index files.

Comment 1 jolee 2011-11-01 16:33:08 UTC
Link: Added: This issue Cloned from TEIID-1803


Comment 2 jolee 2011-11-01 16:36:02 UTC
Security: Added: Public


Comment 3 jolee 2011-11-01 19:19:33 UTC
Link: Added: This issue Cloned to SOA-3544


Comment 4 Van Halbert 2011-11-11 04:45:53 UTC
Date: 2011-11-03 10:09:11 -0400 (Thu, 03 Nov 2011)
New Revision: 3604

Modified:
  trunk/metadata/src/main/java/org/teiid/metadata/index/IndexMetadataFactory.java
  trunk/metadata/src/main/java/org/teiid/metadata/index/RecordFactory.java


Comment 5 jolee 2011-12-07 14:39:41 UTC
Link: Added: This issue is a dependency of SOA-3544


Comment 6 jolee 2011-12-07 14:40:33 UTC
Link: Added: This issue depends TEIID-1803