Bug 1418659

Summary: [RFE] Add fluentd configuration for parsing engine.log
Product: [oVirt] ovirt-engine-metrics Reporter: Shirly Radco <sradco>
Component: RFEsAssignee: Shirly Radco <sradco>
Status: CLOSED CURRENTRELEASE QA Contact: Lukas Svaty <lsvaty>
Severity: high Docs Contact:
Priority: unspecified    
Version: 1.0.0CC: bugs, didi, lsvaty, melewis, sradco, stirabos, ylavi
Target Milestone: ovirt-4.1.3Keywords: FutureFeature
Target Release: 1.0.4.2Flags: rule-engine: ovirt-4.1+
ylavi: planning_ack+
sradco: devel_ack+
lsvaty: testing_ack+
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Enhancement
Doc Text:
With this update, engine.log has been added to the logs collection. The records are now parsed and sent to the central metrics store. This allows the administrator to analyse the logs in a more simple and comfortable way. This means that the engine.log records are available for analysis in Kibana.
Story Points: ---
Clone Of: Environment:
Last Closed: 2017-07-06 13:11:34 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Metrics RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1402901, 1456459    

Description Shirly Radco 2017-02-02 12:39:00 UTC
Description of problem:
We would like to be able to have log analytics.
For that we need to create the fluentd.con that will parse the logs and send them to the metrics store.

Comment 1 Shirly Radco 2017-04-06 12:24:48 UTC
This bug also includes deploying the new logs config on the engine machine.

Comment 2 Lukas Svaty 2017-06-20 13:21:35 UTC
[root@ls-engine1 ~]# ls /etc/fluentd/config.d/20-ovirt-engine-logs-processing.conf 
/etc/fluentd/config.d/20-ovirt-engine-logs-processing.conf

logs in kibana available under tag:
    project.ovirt-logs-engine