Bugzilla will be upgraded to version 5.0. The upgrade date is tentatively scheduled for 2 December 2018, pending final testing and feedback.
Bug 1414271 - Extend configuration for Gnocchi at install/setup time through Director. [NEEDINFO]
Extend configuration for Gnocchi at install/setup time through Director.
Status: CLOSED ERRATA
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-tripleo-heat-templates (Show other bugs)
10.0 (Newton)
Unspecified Unspecified
medium Severity low
: ga
: 12.0 (Pike)
Assigned To: Pradeep Kilambi
Sasha Smolyak
FailedQA
: Triaged
Depends On:
Blocks: 1470821
  Show dependency treegraph
 
Reported: 2017-01-18 03:46 EST by Irina Petrova
Modified: 2018-02-05 14:04 EST (History)
10 users (show)

See Also:
Fixed In Version: openstack-tripleo-heat-templates-7.0.3-11.el7ost puppet-gnocchi-11.3.0-1.el7ost
Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of:
Environment:
Last Closed: 2017-12-13 16:00:46 EST
Type: Bug
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---
ssmolyak: needinfo? (pkilambi)


Attachments (Terms of Use)


External Trackers
Tracker ID Priority Status Summary Last Updated
OpenStack gerrit 511233 None None None 2017-10-11 09:26 EDT
OpenStack gerrit 511236 None None None 2017-10-11 09:26 EDT
OpenStack gerrit 515683 None None None 2017-11-15 13:20 EST
OpenStack gerrit 515684 None None None 2017-11-15 13:20 EST
Red Hat Product Errata RHEA-2017:3462 normal SHIPPED_LIVE Red Hat OpenStack Platform 12.0 Enhancement Advisory 2018-02-15 20:43:25 EST

  None (edit)
Description Irina Petrova 2017-01-18 03:46:49 EST
Description of problem:

Based on some performance tests:

   ~~~
   The installer will configure much less metricd processing workers than
   you will likely require for large scale with the defaults.
   You may need to tune metric_processing_delay at the expense of system
   resources to obtain your aggregated measures closer to realtime.
   Due to the higher system usage (cpu usage) on the machines hosting
   metricd, I would advise moving Gnocchi API and metricd to a separate
   machine. 
   Ceph needs pgs tuned for metrics pool (In my case I used another yaml
   in tripleo to bump the number of PGs to 512 (36 total OSDs)).

   ...
   In order to get the 1,000 instances all on the low archival-policy
   setting with default metrics collected I had to adjust two settings to
   gnocchi.conf                     <----------------------
   workers = 48                     <----------------------
   metric_processing_delay = 30     <----------------------
   ~~~

We recommended to a customer to tweak the number of workers and metric_processing_delay. The results were promising but as we don't see any metric_processing_delay parameter in the gnocchi puppet manifests [1], we would like to request them added.

If there's a better way to configure/update those via TripleO, please move the BZ to the appropriate BZ Component and or advise on it.

The goal is simple:
Configure gnocchi.conf at install/setup time through the Director.


[1] https://github.com/openstack/puppet-gnocchi/tree/stable/newton/manifests
Comment 2 Pradeep Kilambi 2017-05-02 10:09:49 EDT
The pupet patches have landed. I'll check the builds and move to modified.
Comment 5 Sasha Smolyak 2017-07-13 08:24:22 EDT
What about changeable number of workers? Did we drop that feature?
Comment 6 Pradeep Kilambi 2017-07-13 10:02:55 EDT
The workers support is already in place:

https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/gnocchi-metricd.yaml#L32-L35

hence not in the patch listed.
Comment 12 Jon Schlueter 2017-11-21 16:25:44 EST
openstack-tripleo-heat-templates-7.0.3-11.el7ost
Comment 16 Sasha Smolyak 2017-12-13 07:12:11 EST
There are still remainings of the same code in /usr/share/openstack-tripleo-heat-templates/puppet/services/gnocchi-base.yaml:

  MetricProcessingDelay:
    default: 30
    description: Delay between processing metrics.

        gnocchi::storage::metric_processing_delay: {get_param: MetricProcessingDelay}

Don't we need to clean it from there?
Comment 19 errata-xmlrpc 2017-12-13 16:00:46 EST
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2017:3462

Note You need to log in before you can comment on or make changes to this bug.