Bug 1418659 – [RFE] Add fluentd configuration for parsing engine.log

Bugzilla will be upgraded to version 5.0. The upgrade date is tentatively scheduled for 2 December 2018, pending final testing and feedback.

Bug 1418659 - [RFE] Add fluentd configuration for parsing engine.log

Summary:	[RFE] Add fluentd configuration for parsing engine.log

Status:	CLOSED CURRENTRELEASE

Aliases:	None

Product:	ovirt-engine-metrics
Classification:	oVirt
Component:	RFEs (Show other bugs)
Sub Component:
Version:	1.0.0
Hardware:	Unspecified Unspecified

Priority	unspecified Severity high
Target Milestone:	ovirt-4.1.3
Target Release:	1.0.4.2
Assigned To:	Shirly Radco
QA Contact:	Lukas Svaty
Docs Contact:

URL:
Whiteboard:
Keywords:	FutureFeature

Depends On:
Blocks:	oVirt-Metrics-and-Logs 1456459
	Show dependency tree / graph

Reported:	2017-02-02 07:39 EST by Shirly Radco
Modified:	2017-11-01 21:17 EDT (History)
CC List:	7 users (show)

See Also:
Fixed In Version:
Doc Type:	Enhancement
Doc Text:	With this update, engine.log has been added to the logs collection. The records are now parsed and sent to the central metrics store. This allows the administrator to analyse the logs in a more simple and comfortable way. This means that the engine.log records are available for analysis in Kibana.
Story Points:	---
Clone Of:
Environment:
Last Closed:	2017-07-06 09:11:34 EDT
Type:	Bug
Regression:	---
Mount Type:	---
Documentation:	---
CRM:
Verified Versions:
Category:	---
oVirt Team:	Metrics
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---

Flags:	rule-engine: ovirt‑4.1+ ylavi: planning_ack+ sradco: devel_ack+ lsvaty: testing_ack+

Attachments	(Terms of Use)
Add an attachment (proposed patch, testcase, etc.)

External Trackers
Tracker	ID	Priority	Status	Summary	Last Updated
oVirt gerrit	75358	master	MERGED	fluentd:added engine.log to the fluentd configuration	2017-06-05 09:03 EDT

Groups: None (edit)

Description Shirly Radco 2017-02-02 07:39:00 EST

Description of problem:
We would like to be able to have log analytics.
For that we need to create the fluentd.con that will parse the logs and send them to the metrics store.

Comment 1 Shirly Radco 2017-04-06 08:24:48 EDT

This bug also includes deploying the new logs config on the engine machine.

Comment 2 Lukas Svaty 2017-06-20 09:21:35 EDT

[root@ls-engine1 ~]# ls /etc/fluentd/config.d/20-ovirt-engine-logs-processing.conf 
/etc/fluentd/config.d/20-ovirt-engine-logs-processing.conf

logs in kibana available under tag:
    project.ovirt-logs-engine

Note You need to log in before you can comment on or make changes to this bug.