Bug 1422599 - Switch Cassandra to use TWCS compaction
Summary: Switch Cassandra to use TWCS compaction
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Hawkular
Version: 3.4.1
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
: 3.4.z
Assignee: Matt Wringe
QA Contact: Peng Li
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2017-02-15 16:33 UTC by Matt Wringe
Modified: 2017-02-22 22:31 UTC (History)
3 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Cause: Cassandra was using size tiered compaction and was not performing compactions as often as expected. Consequence: Without the compactions occurring as expected, Cassandra would have to deal with extra stale data which would increase the resources required and cause Cassandra to become unstable in some situations. Fix: The compaction strategy for Cassandra was changed from size tiered compaction to time window compaction. A better strategy for the time series data we are storing. Result: Cassandra should be more stable and perform better.
Clone Of:
Environment:
Last Closed: 2017-02-22 18:33:47 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2017:0290 0 normal SHIPPED_LIVE OpenShift Container Platform 3.4.1.7, 3.3.1.14, and 3.2.1.26 images update 2017-02-22 23:30:53 UTC

Description Matt Wringe 2017-02-15 16:33:33 UTC
Description of problem:
General stability problems with Hawkular Metrics / Cassandra due to using an inefficient compaction strategy

These related to 
https://bugzilla.redhat.com/show_bug.cgi?id=1411427
https://bugzilla.redhat.com/show_bug.cgi?id=1416850

Comment 2 Troy Dawson 2017-02-15 23:11:43 UTC
This should be fixed in openshift3/metrics-hawkular-metrics:3.4.1-6, or newer, which should be in all the standard testing areas.

Comment 8 Peng Li 2017-02-16 02:54:35 UTC
Created attachment 1250767 [details]
hawkular-metrics pod log

Comment 12 errata-xmlrpc 2017-02-22 18:33:47 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2017:0290


Note You need to log in before you can comment on or make changes to this bug.