Bugzilla will be upgraded to version 5.0. The upgrade date is tentatively scheduled for 2 December 2018, pending final testing and feedback.
First Last Prev Next    This bug is not in your last search results.
Bug 1337961 - Missing time-based Events filtering
Missing time-based Events filtering
Status: CLOSED ERRATA
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-ceilometer (Show other bugs)
unspecified
Unspecified Unspecified
urgent Severity urgent
: ga
: 9.0 (Mitaka)
Assigned To: Pradeep Kilambi
Yurii Prokulevych
: FutureFeature, Triaged
Depends On:
Blocks: 1337429
  Show dependency tree / graph
 
Reported: 2016-05-20 10:43 EDT by Marek Aufart
Modified: 2016-08-11 08:22 EDT (History)
10 users (show)

See Also:
Fixed In Version: openstack-ceilometer-6.1.2-1.el7ost
Doc Type: Bug Fix
Doc Text:
Prior to this update, events could not be filtered by time-based fields. Consequently, `le` and `ge` queries did not work on time-based fields. This update adds new query operators, with the result that the `le` and `ge` operators should now work on time-based queries.
Story Points: ---
Clone Of:
Environment:
Last Closed: 2016-08-11 08:22:13 EDT
Type: Bug
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---

Attachments (Terms of Use)
Add an attachment (proposed patch, testcase, etc.)


External Trackers
Tracker ID Priority Status Summary Last Updated
Red Hat Product Errata RHEA-2016:1597 normal SHIPPED_LIVE Red Hat OpenStack Platform 9 Release Candidate Advisory 2016-08-11 12:06:52 EDT

  None (edit)
Description Marek Aufart 2016-05-20 10:43:15 EDT 
Description of problem:
It looks that Events cannot be filtered by time-based fields (timestamp_start or something similar).

In previous versions (part of kilo) timestamp filtering worked at least somehow [1]. In new versions (in mitaka) error is raised when gt operator is used on timestamp_start field.


Version-Release number of selected component (if applicable): 6 (propably)


How reproducible: always


Steps to Reproduce:
1. query ceilometer API with {'field' => 'start_timestamp','op' => 'gt','value' => '2016-05-13T06:46:23'}

Actual results: error Operator gt is not supported. Only equality operator is available for field start_timestamp


Expected results: list of events filtered by start_timestamp (or other time-like field)

Additional info:
It was disabled in https://github.com/openstack/ceilometer/commit/ac3ff88c03ea3685d7f3511bbae16785646e56ba

[1] http://paste.openstack.org/show/497913/
Comment 2 Julien Danjou 2016-06-08 06:11:51 EDT 
I'll look into implementing that.
Comment 4 Julien Danjou 2016-06-27 11:49:22 EDT 
The feature never existed AFAIU, there was a bug that allowed to run this kind of query but it'd return invalid data. A sanity check has been added in Liberty, which blocked that altogether.
Comment 6 Mehdi ABAAKOUK 2016-06-28 10:34:41 EDT 
I confirm that this feature have never been implemented, but they are a good chance that it was working by accident if the storage backend was mongodb and the fields are start_timestamp and/or end_timestamp, because the code that build the mongodb query is shared between events and samples API, and samples API supports gt/ge.
Comment 7 Marek Aufart 2016-06-28 10:47:30 EDT 
Regarding to documentation at [1], EventQuery looked to me, that it can be used for filtering and I didn't see any operator restriction there. So it looked as an intended behaviour.

We are open to change our event querying to other way which is supported, but unfortonately it looks there is not such way (and that is the reason for this BZ).

[1] http://docs.openstack.org/developer/ceilometer/webapi/v2.html#get--v2-events
Comment 8 Marek Aufart 2016-07-11 05:12:32 EDT 
@Julien: Thanks a lot for the "fix" https://review.openstack.org/#/c/338390/

Would it be possible get it into Mitaka release?
Comment 9 Julien Danjou 2016-07-12 13:04:10 EDT 
(In reply to Marek Aufart from comment #8)
> @Julien: Thanks a lot for the "fix" https://review.openstack.org/#/c/338390/
> 
> Would it be possible get it into Mitaka release?

That is my plan ^^
Comment 10 Julien Danjou 2016-07-15 11:59:57 EDT 
Fixed in Ceilometer 6.1.2, need to rebase the package.
Comment 12 Julien Danjou 2016-07-18 09:56:59 EDT 
To test, what used to work and now shuold work again is to filter by timestamp the events using `le' and `ge' operetors on end_timestamp and start_timestamp respectively. Before this bug was fixed, only `eq' was accepted while the real operator being applied was le or ge.

The Ceilometer client should be able to emit this query with "ceilometer event-list --query".
Comment 14 Yurii Prokulevych 2016-07-21 09:10:13 EDT 
Tested with packages:
---------------------
openstack-ceilometer-compute-6.1.2-1.el7ost.noarch
python-ceilometerclient-2.3.0-1.el7ost.noarch
openstack-ceilometer-collector-6.1.2-1.el7ost.noarch
openstack-ceilometer-common-6.1.2-1.el7ost.noarch
python-ceilometer-6.1.2-1.el7ost.noarch
openstack-ceilometer-api-6.1.2-1.el7ost.noarch
openstack-ceilometer-notification-6.1.2-1.el7ost.noarch
openstack-ceilometer-polling-6.1.2-1.el7ost.noarch
openstack-ceilometer-central-6.1.2-1.el7ost.noarch


ceilometer event-list --no-traits
+--------------------------------------+-----------------------+----------------------------+
| Message ID                           | Event Type            | Generated                  |
+--------------------------------------+-----------------------+----------------------------+
| f89f70a4-b89b-447c-a7fc-6e91db5f3622 | volume.create.start   | 2016-07-21T12:42:23.234000 |
| 4572c026-e5c7-4c5e-bce0-0ad04bf8a2eb | volume.create.end     | 2016-07-21T12:42:23.756000 |
| 5058cdfd-39a1-4e22-afb5-5c798161dff2 | network.create.start  | 2016-07-21T12:43:57.591000 |
| 552d28b9-6078-4b14-910e-8cb40e149933 | network.create.end    | 2016-07-21T12:43:57.844000 |
| 56accbdb-8548-4d67-8594-f280890ed529 | subnet.create.start   | 2016-07-21T12:46:41.011000 |
| 5a58c3be-162d-4959-897e-e7397487762c | subnet.create.end     | 2016-07-21T12:46:41.305000 |
| 127e53dd-dfad-4785-9ea8-8a14ed3d8273 | snapshot.create.start | 2016-07-21T12:48:54.742000 |
| 510bbed6-2984-44ee-a4e5-c55e90c5ca7b | snapshot.create.end   | 2016-07-21T12:48:55.224000 |
| 2214bac0-63fd-4187-ac94-178216f14abb | snapshot.create.start | 2016-07-21T12:50:37.363000 |
| 81586be2-655c-4285-9021-5b666a3b93f0 | snapshot.create.end   | 2016-07-21T12:50:37.842000 |
| 673286b8-15be-4c38-86cd-f97f3bfde84b | snapshot.delete.start | 2016-07-21T12:50:59.297000 |
| 40033b9c-0621-4052-99f5-ba37a430b8d1 | snapshot.delete.end   | 2016-07-21T12:51:01.819000 |
| 2b01bab0-df79-4a01-8787-e7a8c76950ea | snapshot.delete.start | 2016-07-21T12:51:38.813000 |
| 84c52a59-b365-4bfd-810c-774ee30d1acd | snapshot.delete.end   | 2016-07-21T12:51:41.204000 |
| 13f84266-05ef-4d67-ac66-2df1b7d7fd69 | volume.delete.start   | 2016-07-21T12:52:31.156000 |
| 0f796ebe-6be0-416c-9953-f17971a05a23 | volume.delete.end     | 2016-07-21T12:52:33.418000 |
| 6d99d315-e1b8-47d7-a9b0-27eec6acc362 | image.update          | 2016-07-21T12:54:45.155000 |
| 5b508520-9326-4c4e-b5e4-04e6e5bbb637 | image.upload          | 2016-07-21T12:54:58.354000 |
| 73f544ce-c0f7-41c3-b2a6-85445fa07d3e | image.update          | 2016-07-21T12:54:58.452000 |
+--------------------------------------+-----------------------+----------------------------+

Filter with 'ge':
ceilometer event-list --no-traits --query "start_timestamp>=2016-07-21T12:54:45"
+--------------------------------------+--------------+----------------------------+
| Message ID                           | Event Type   | Generated                  |
+--------------------------------------+--------------+----------------------------+
| 6d99d315-e1b8-47d7-a9b0-27eec6acc362 | image.update | 2016-07-21T12:54:45.155000 |
| 5b508520-9326-4c4e-b5e4-04e6e5bbb637 | image.upload | 2016-07-21T12:54:58.354000 |
| 73f544ce-c0f7-41c3-b2a6-85445fa07d3e | image.update | 2016-07-21T12:54:58.452000 |
+--------------------------------------+--------------+----------------------------+

Filter with 'le':
ceilometer event-list --no-traits --query "end_timestamp<=2016-07-21T12:43:50"
+--------------------------------------+---------------------+----------------------------+
| Message ID                           | Event Type          | Generated                  |
+--------------------------------------+---------------------+----------------------------+
| f89f70a4-b89b-447c-a7fc-6e91db5f3622 | volume.create.start | 2016-07-21T12:42:23.234000 |
| 4572c026-e5c7-4c5e-bce0-0ad04bf8a2eb | volume.create.end   | 2016-07-21T12:42:23.756000 |
+--------------------------------------+---------------------+----------------------------+

Compound query "ge & le":
ceilometer event-list --no-traits --query "start_timestamp>=2016-07-21T12:46:50;end_timestamp<=2016-07-21T12:52:30"
+--------------------------------------+-----------------------+----------------------------+
| Message ID                           | Event Type            | Generated                  |
+--------------------------------------+-----------------------+----------------------------+
| 127e53dd-dfad-4785-9ea8-8a14ed3d8273 | snapshot.create.start | 2016-07-21T12:48:54.742000 |
| 510bbed6-2984-44ee-a4e5-c55e90c5ca7b | snapshot.create.end   | 2016-07-21T12:48:55.224000 |
| 2214bac0-63fd-4187-ac94-178216f14abb | snapshot.create.start | 2016-07-21T12:50:37.363000 |
| 81586be2-655c-4285-9021-5b666a3b93f0 | snapshot.create.end   | 2016-07-21T12:50:37.842000 |
| 673286b8-15be-4c38-86cd-f97f3bfde84b | snapshot.delete.start | 2016-07-21T12:50:59.297000 |
| 40033b9c-0621-4052-99f5-ba37a430b8d1 | snapshot.delete.end   | 2016-07-21T12:51:01.819000 |
| 2b01bab0-df79-4a01-8787-e7a8c76950ea | snapshot.delete.start | 2016-07-21T12:51:38.813000 |
| 84c52a59-b365-4bfd-810c-774ee30d1acd | snapshot.delete.end   | 2016-07-21T12:51:41.204000 |
+--------------------------------------+-----------------------+----------------------------+
Comment 16 errata-xmlrpc 2016-08-11 08:22:13 EDT 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHEA-2016-1597.html
Note You need to log in before you can comment on or make changes to this bug.
First Last Prev Next    This bug is not in your last search results.