Bug 777585 (SOA-93)

Summary: WS Benchmark tests on SOA Platform show performance degradation compared to results on Tomcat
Product: [JBoss] JBoss Enterprise SOA Platform 4 Reporter: Thomas Diesler <thomas.diesler>
Component: JBossWSAssignee: Jim Ma <ema>
Status: CLOSED NEXTRELEASE QA Contact:
Severity: high Docs Contact:
Priority: high    
Version: 4.2 CP01CC: hbraun
Target Milestone: ---   
Target Release: 4.3 IR5   
Hardware: Unspecified   
OS: Unspecified   
URL: http://jira.jboss.org/jira/browse/SOA-93
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2008-10-23 18:42:45 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Attachments:
Description Flags
PerformanceAnalysis_WS.2.0.1_SP2.odt
none
benchmark_suite.zip
none
ws_performance_test_invm.odt none

Description Thomas Diesler 2007-11-05 11:28:53 UTC 
Date of First Response: 2007-11-05 14:23:15
project_key: SOA

Mark sais:

Once ESB 4.2.1 has GA-ed later today, our focus will turn to getting the platform out on time (17th of December). Amongst other things, one of the areas we could really do with help is on stressing the platform as a whole and checking that it does what it says it does! In HP we used to have something called a test-a-thon for each product release, where the entire middleware division would devote some time to stressing the next release of a product. How much time depended on the individuals and groups, but even a few hours often brought valuable feedback that assisted the product and QA. It would be good if you could plan with your teams some time over the next few weeks to go through the next beta of the platform, testing your own project's integration as well as others. If this works out and there's enough interest, maybe we could extend this to the individual projects.
Comment 2 Len DiMaggio 2007-11-05 19:23:15 UTC 
Link: Added: This issue is related to SOA-85
Comment 3 Heiko Braun 2007-11-13 09:15:43 UTC 
Can you point me to the branch/build instructions for the release that should be tested? Are there any constraints on how these tests need to be executed? As a one shot or automated?
Comment 4 Heiko Braun 2007-11-19 10:42:01 UTC 
Attachment: Added: PerformanceAnalysis_WS.2.0.1_SP2.odt
Comment 5 Heiko Braun 2007-11-19 10:42:53 UTC 
I've tested against the following ESB version:
URL: https://svn.labs.jboss.com/labs/jbossesb/branches/JBESB_4_2_1_GA_CP
Repository Root: https://svn.labs.jboss.com
Repository UUID: c60d74c8-e8f6-0310-9e8f-d4a2fc68ab70
Revision: 16627

Please see the results attached.
Comment 6 Heiko Braun 2007-11-19 10:44:08 UTC 
My results have been using a manual setup and execution of the test cases. For future runs, we need to integrate with the ESB QA environment to run them in an automated fashion.
Comment 9 Heiko Braun 2007-11-20 10:22:51 UTC 
Attachment: Added: benchmark_suite.zip
Comment 11 Jim Ma 2008-07-22 11:13:01 UTC 
Attachment: Added: ws_performance_test_invm.odt
Comment 12 nwallace 2008-09-26 06:42:52 UTC 
Link: Added: This issue related SOA-877