Bug 777724 (SOA-240)

Summary: Benchmark test: define borders for success
Product: [JBoss] JBoss Enterprise SOA Platform 4 Reporter: Martin Vecera <mvecera>
Component: QEAssignee: Martin Vecera <mvecera>
Status: CLOSED NEXTRELEASE QA Contact:
Severity: high Docs Contact:
Priority: high    
Version: 4.2 IR8   
Target Milestone: ---   
Target Release: 4.2 GA   
Hardware: Unspecified   
OS: Unspecified   
URL: http://jira.jboss.org/jira/browse/SOA-240
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2008-02-19 17:05:39 UTC Type: Task
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Attachments:
Description Flags
soa_performance.ods none

Description Martin Vecera 2007-12-17 15:05:43 UTC 
Date of First Response: 2007-12-17 12:08:54
project_key: SOA

To SOA-P benchmark test (for instance http://testify.test.redhat.com/testplans.cgi?op=view&id=516) define when the test case should be marked as passed.

Performance 1: > 100 msg/s
Performance 2:
Performance 3:
Performance 4:
Performance 5:
Performance 6:
Performance 7:
Performance 8:
Comment 1 Mark Little 2007-12-17 17:08:54 UTC 
Changed the Affects Field, since you can't have an Affects on something we haven't released!
Comment 2 Martin Vecera 2007-12-18 09:30:41 UTC 
This was intended as a future item - we will start defining the borders with IR9, so I think it was correct.
Comment 3 Martin Vecera 2008-01-09 11:15:29 UTC 
Last results from working tests (see Hudson).
The numbers are in messages per sec.

RHEL4
1: 235
3: 78
7: 149
8: 3.8 - CBR, 1000 rules (~150 kB file) - poor performance!

RHEL5
1: 225
3: 67
7: 138
8: 2.6

Win2k3
1: 218
3: 48
7: 129
8: We can't expect anything surprising here...
Comment 4 Martin Vecera 2008-01-10 11:23:27 UTC 
Win2k3
8: 6.3 msgs/sec with 100 rules - still very bad performance
Comment 5 Martin Vecera 2008-01-16 16:04:43 UTC 
RHEL4
8: 19 msgs/sec with 100 rules
Comment 7 Len DiMaggio 2008-01-21 03:28:04 UTC 
Attachment: Added: soa_performance.ods
Comment 9 Martin Vecera 2008-01-21 13:12:49 UTC 
Link: Added: This issue is related to JBESB-1504
Comment 10 Martin Vecera 2008-01-21 13:19:30 UTC 
Link: Added: This issue related SOA-346
Comment 11 Martin Vecera 2008-01-22 10:33:49 UTC 
RHEL4 - beta2
1: 233
3: 82
7: 150
8: 20.5 (100 rules)
Comment 12 Martin Vecera 2008-01-22 13:19:33 UTC 
RHEL5 - beta2
1: 233
3: 67
7: 150
8: 17.7 (100 rules)
Comment 14 Martin Vecera 2008-01-23 07:43:18 UTC 
Win2k3
1: 232
3: 48
7: 131
8: 6.2 (100 rules)
Comment 15 Martin Vecera 2008-01-28 07:21:14 UTC 
RHEL4 - CR1
1: 225
3: 80
7: 174
8: 20
Comment 16 Martin Vecera 2008-01-28 07:22:42 UTC 
RHEL5 - CR1
1: 220
3: 66
7: 140
8: 18
Comment 17 Len DiMaggio 2008-02-19 17:05:39 UTC 
Closing this tracker issue for SOA-P 4.2.0 GA - we'll create new tracking JIRAs as needed for CP1, etc.