Bugzilla will be upgraded to version 5.0. The upgrade date is tentatively scheduled for 2 December 2018, pending final testing and feedback.
Bug 1042323 - [RFE][ceilometer]: ElasticSearch Storage Driver Support
[RFE][ceilometer]: ElasticSearch Storage Driver Support
Status: CLOSED ERRATA
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-ceilometer (Show other bugs)
unspecified
Unspecified Unspecified
medium Severity medium
: Upstream M2
: 7.0 (Kilo)
Assigned To: Eoghan Glynn
Yurii Prokulevych
https://blueprints.launchpad.net/ceil...
upstream_milestone_kilo-2 upstream_st...
: FutureFeature, OtherQA, TechPreview, Triaged
Depends On:
Blocks:
  Show dependency treegraph
 
Reported: 2013-12-12 16:45 EST by RHOS Integration
Modified: 2015-08-05 09:11 EDT (History)
7 users (show)

See Also:
Fixed In Version: openstack-ceilometer-2015.1.0-2.el7ost
Doc Type: Technology Preview
Doc Text:
Story Points: ---
Clone Of:
Environment:
Last Closed: 2015-08-05 09:11:09 EDT
Type: ---
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---


Attachments (Terms of Use)


External Trackers
Tracker ID Priority Status Summary Last Updated
Red Hat Product Errata RHEA-2015:1548 normal SHIPPED_LIVE Red Hat Enterprise Linux OpenStack Platform Enhancement Advisory 2015-08-05 13:07:06 EDT

  None (edit)
Description RHOS Integration 2013-12-12 16:45:12 EST
Cloned from launchpad blueprint https://blueprints.launchpad.net/ceilometer/+spec/elasticsearch-driver.

Description:

This bp implements ElasticSearch Storage driver.

ElasticSearch: http://www.elasticsearch.org/
ElasticSearch has good query language and UI  : Kibana3 http://three.kibana.org/

ElasticSearch is also good for storing logs, so we can use ceilometer + Elasticsearch as Log as a Service framework.



Specification URL (additional information):

None
Comment 3 Yurii Prokulevych 2015-04-07 11:24:36 EDT
Hi Eoghan,

I do have some questions regarding the RFE:

1. Is this driver applicable also for meters/alarms storing or just for events?

2. Elasticsearh version suppose to be >= 1.3.0 ?

3. Is Kibana needed for testing? If yes what version?

4. Elasticsearch/Kibana configuration - deployer is responsible for setting/configuring them up? Or it would be also part of packstack/staypufft installers?
    Would ES/Kibana put into our repo or should be downloaded from the www.elastic.co site?

5. Connection URL format:
    According to http://www.elastic.co/guide/en/elasticsearch/guide/current/_indexing_employee_documents.html
    'The index name' and 'the type name' have to be provided. 
    So what is the format of {event|alarm|metring}_connection option in ceilometer.conf. Something like:
        event_connection=es://<hostname|ip>:<port>/<index_name>/<type_name> ?
    What are valid names for the 'index/type' names?

6. If events are stored in ES it's still doable to get events list via 'ceilometer event-list' call?

7. How is Elasticsearch inaccessibility handled?(predefined amount of retries or smth?)

Thanks in advance.

Regards,
Yurii
Comment 5 gchung 2015-05-04 09:40:59 EDT
1. Is this driver applicable also for meters/alarms storing or just for events?
 - as discussed, it only stores events

2. Elasticsearh version suppose to be >= 1.3.0 ?
 - i've been testing against >= 1.3.0 but i'm not sure if there's a minimum version required

3. Is Kibana needed for testing? If yes what version?
 - not required but can be used. versioning will probably be based on elasticsearch version

4. Elasticsearch/Kibana configuration - deployer is responsible for setting/configuring them up? Or it would be also part of packstack/staypufft installers?
    Would ES/Kibana put into our repo or should be downloaded from the www.elastic.co site?
 - there is 0 configuration done on ceilometer end. it just connects to a specific url

5. Connection URL format:
    According to http://www.elastic.co/guide/en/elasticsearch/guide/current/_indexing_employee_documents.html
    'The index name' and 'the type name' have to be provided. 
    So what is the format of {event|alarm|metring}_connection option in ceilometer.conf. Something like:
        event_connection=es://<hostname|ip>:<port>/<index_name>/<type_name> ?
    What are valid names for the 'index/type' names?
 - the index is events_YYYY-MM-DD, and the type are each possible event_type of notifications

6. If events are stored in ES it's still doable to get events list via 'ceilometer event-list' call?
 - yes, elasticsearch backend supports the same queries as other backends in addition to kibana. ie. event-list, event-type-list, trait-list, trait-type-list

7. How is Elasticsearch inaccessibility handled?(predefined amount of retries or smth?)
 - i don't really have an answer for this, i didn't consider this.
Comment 13 errata-xmlrpc 2015-08-05 09:11:09 EDT
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2015:1548

Note You need to log in before you can comment on or make changes to this bug.