Bug 777585 (SOA-93) - WS Benchmark tests on SOA Platform show performance degradation compared to results on Tomcat
Summary: WS Benchmark tests on SOA Platform show performance degradation compared to r...
Keywords:
Status: CLOSED NEXTRELEASE
Alias: SOA-93
Product: JBoss Enterprise SOA Platform 4
Classification: JBoss
Component: JBossWS
Version: 4.2 CP01
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: ---
: 4.3 IR5
Assignee: Jim Ma
QA Contact:
URL: http://jira.jboss.org/jira/browse/SOA-93
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2007-11-05 11:28 UTC by Thomas Diesler
Modified: 2008-10-23 18:42 UTC (History)
1 user (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2008-10-23 18:42:45 UTC
Type: Bug


Attachments (Terms of Use)
PerformanceAnalysis_WS.2.0.1_SP2.odt (16.43 KB, application/vnd.oasis.opendocument.text)
2007-11-19 10:42 UTC, Heiko Braun
no flags Details
benchmark_suite.zip (28.03 KB, application/zip)
2007-11-20 10:22 UTC, Heiko Braun
no flags Details
ws_performance_test_invm.odt (14.65 KB, application/vnd.oasis.opendocument.text)
2008-07-22 11:13 UTC, Jim Ma
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Red Hat Bugzilla 777577 0 urgent CLOSED ESB performance bug blocking large queue backlog stress testing 2021-02-22 00:41:40 UTC
Red Hat Bugzilla 778393 0 high CLOSED WS Benchmark tests on SOA Platform show performance degradation compared to results on Tomcat 2021-02-22 00:41:40 UTC
Red Hat Issue Tracker SOA-93 0 None None None Never

Internal Links: 777577 778393

Description Thomas Diesler 2007-11-05 11:28:53 UTC
Date of First Response: 2007-11-05 14:23:15
project_key: SOA

Mark sais:

Once ESB 4.2.1 has GA-ed later today, our focus will turn to getting the platform out on time (17th of December). Amongst other things, one of the areas we could really do with help is on stressing the platform as a whole and checking that it does what it says it does! In HP we used to have something called a test-a-thon for each product release, where the entire middleware division would devote some time to stressing the next release of a product. How much time depended on the individuals and groups, but even a few hours often brought valuable feedback that assisted the product and QA. It would be good if you could plan with your teams some time over the next few weeks to go through the next beta of the platform, testing your own project's integration as well as others. If this works out and there's enough interest, maybe we could extend this to the individual projects.

Comment 2 Len DiMaggio 2007-11-05 19:23:15 UTC
Link: Added: This issue is related to SOA-85


Comment 3 Heiko Braun 2007-11-13 09:15:43 UTC
Can you point me to the branch/build instructions for the release that should be tested? Are there any constraints on how these tests need to be executed? As a one shot or automated?

Comment 4 Heiko Braun 2007-11-19 10:42:01 UTC
Attachment: Added: PerformanceAnalysis_WS.2.0.1_SP2.odt


Comment 5 Heiko Braun 2007-11-19 10:42:53 UTC
I've tested against the following ESB version:
URL: https://svn.labs.jboss.com/labs/jbossesb/branches/JBESB_4_2_1_GA_CP
Repository Root: https://svn.labs.jboss.com
Repository UUID: c60d74c8-e8f6-0310-9e8f-d4a2fc68ab70
Revision: 16627

Please see the results attached.



Comment 6 Heiko Braun 2007-11-19 10:44:08 UTC
My results have been using a manual setup and execution of the test cases. For future runs, we need to integrate with the ESB QA environment to run them in an automated fashion.

Comment 9 Heiko Braun 2007-11-20 10:22:51 UTC
Attachment: Added: benchmark_suite.zip


Comment 11 Jim Ma 2008-07-22 11:13:01 UTC
Attachment: Added: ws_performance_test_invm.odt


Comment 12 nwallace 2008-09-26 06:42:52 UTC
Link: Added: This issue related SOA-877



Note You need to log in before you can comment on or make changes to this bug.