Bug 1163616 - Reduce the overhead of clustered caches
Summary: Reduce the overhead of clustered caches
Keywords:
Status: ASSIGNED
Alias: None
Product: JBoss Data Grid 6
Classification: JBoss
Component: Infinispan
Version: 6.3.1
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
: 6.5.0
Assignee: Tristan Tarrant
QA Contact: Martin Gencur
URL:
Whiteboard:
Depends On:
Blocks: 1186874
TreeView+ depends on / blocked
 
Reported: 2014-11-13 06:21 UTC by Osamu Nagano
Modified: 2022-03-03 09:11 UTC (History)
3 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed:
Type: Bug
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker ISPN-4842 0 Major Open Reduce the overhead of clustered caches 2019-05-09 01:21:43 UTC

Description Osamu Nagano 2014-11-13 06:21:20 UTC
(This is a tracker of ISPN-4842 for JDG)

Description:
A user is testing 500 nodes cluster with 500 dist caches defined, and plans to expand it to 3000 caches.

Infinispan manages consistent hash per cache, uses a JGroups channel per cache and uses several threads per cache. It gives significant overhead with this large size cluster. When tested with this size, Infinispan easily exhausted all threads in the thread pools and deadlocks, and requires several thousands threads to handle massive JOIN requests - the coord receives 499 * 3000 JOIN requests.

It would be great if we can share the consistent hash and resources between caches. For example, define a "master" dist cache and allow other caches to refer to the master cache for resource sharing.


Note You need to log in before you can comment on or make changes to this bug.