Bug 1481328 - Prevent starved metrics from growing measures unbounded (Ceph and Swift)
Summary: Prevent starved metrics from growing measures unbounded (Ceph and Swift)
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-gnocchi
Version: 11.0 (Ocata)
Hardware: Unspecified
OS: Unspecified
high
urgent
Target Milestone: z2
: 11.0 (Ocata)
Assignee: Pradeep Kilambi
QA Contact: Sasha Smolyak
URL:
Whiteboard:
Depends On: 1478555
Blocks: 1481327
TreeView+ depends on / blocked
 
Reported: 2017-08-14 15:31 UTC by Pradeep Kilambi
Modified: 2017-09-13 21:50 UTC (History)
9 users (show)

Fixed In Version: openstack-gnocchi-3.1.10-2.el7ost
Doc Type: If docs needed, set a value
Doc Text:
Clone Of: 1478555
Environment:
Last Closed: 2017-09-13 21:50:42 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2017:2722 0 normal SHIPPED_LIVE Red Hat OpenStack Platform 11.0 Bug Fix and Enhancement Advisory 2017-09-14 01:48:41 UTC

Description Pradeep Kilambi 2017-08-14 15:31:59 UTC
+++ This bug was initially created as a clone of Bug #1478555 +++

Description of problem:
It is possibly to exceed the capacity of a Tripleo deployed cloud's Telemetry service such that some metrics will never be processed and thus have measures grow unbounded.  When this occurs there is several major failure conditions which will occur based on the speed of the unbounded growth.  This bug's purpose is to support a change to the Gnocchi v3 scheduling of unprocessed data to a "round-robin" function which would reduce the likely hood of a metric being starved and thus growing unbounded.

Version-Release number of selected component (if applicable):
Gnocchi/3.0 - Newton 
Gnocchi/3.1 - Ocata

How reproducible:
With ~100 instances a 3 controller cloud with 24 logical cores/machine (thus 6 workers per controller, 18 total metricd processing workers) will exceed capacity and eventually fail an osd if Ceph.  Swift long term failure conditions are not well know but it is suspected that Swift will eventually slow down when a single container is overloaded with many small objects.

Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

One potential fix [0] that has been proposed is to sort the Gnocchi backlog from oldest to newest and process the oldest backlog first.  This prevents some metrics from being starved and growing their number of measures in the Ceph omap and Ceph metrics pool as 16-byte objects.  It may be possible for Ceph to do the sorting beforehand though that route needs to be investigated.


[0] https://github.com/gnocchixyz/gnocchi/pull/266

Comment 1 Pradeep Kilambi 2017-08-30 13:01:24 UTC
rebased rdo to 3.1.10:

https://review.rdoproject.org/r/9129

Comment 3 Sasha Smolyak 2017-09-05 17:52:29 UTC
Fix is in patch, regression tests pass

Comment 5 errata-xmlrpc 2017-09-13 21:50:42 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2017:2722


Note You need to log in before you can comment on or make changes to this bug.