Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1554244

Summary: [DOCS] Document how to limit logs fluentd is processing
Product: OpenShift Container Platform Reporter: daniel <dmoessne>
Component: DocumentationAssignee: Brandi Munilla <bmcelvee>
Status: CLOSED CURRENTRELEASE QA Contact: Anping Li <anli>
Severity: unspecified Docs Contact: Vikram Goyal <vigoyal>
Priority: high    
Version: 3.9.0CC: aos-bugs, bmcelvee, dmoessne, jokerman, mmccomas, qitang, rmeggins, vigoyal
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-09-25 15:38:43 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description daniel 2018-03-12 08:52:00 UTC 
Based on the discussion in bz 1513409 OCP 3.9 is going back to json as default log driver for docker.

On the of the possibilities we have in fluentd when using json-file or cri-o, is to limit how fast fluentd reads those logs and sends them to Elasticsearch, so that we can throttle logs from "misbehaving" apps, so that they do not overwhelm fluentd and elasticsearch.

This needs to be documented to show how it is done, see 

https://github.com/openshift/origin-aggregated-logging/blob/master/docs/log-drivers-and-throttling.md#log-throttling
Comment 3 Brandi Munilla 2018-07-10 19:54:06 UTC 
Hi Daniel, 

We have a section, "Throttling logs in Fluentd", with instructions on how to do so. 

https://docs.openshift.com/container-platform/3.9/install_config/aggregate_logging.html#aggregated-fluentd

Do you think this is sufficient?

Thanks!
Comment 4 Brandi Munilla 2018-07-23 18:27:49 UTC 
Hey Daniel, just wanted to check in and get your thoughts on Comment 3.

Thanks!
Comment 17 Anping Li 2018-09-04 08:03:51 UTC 
LGTM
Comment 18 openshift-github-bot 2018-09-07 16:44:51 UTC 
Commits pushed to master at https://github.com/openshift/openshift-docs

https://github.com/openshift/openshift-docs/commit/f88daeb0316caef302c4624cc3fbf6cba4850c05
Bug 1554244 Addition example for throttling logs

https://github.com/openshift/openshift-docs/commit/66a65ff62c0dfb76e5075ef513e7e4a6ed5c5667
Merge pull request #11394 from bmcelvee/BZ1554244

Bug 1554244 Addition example for throttling logs
Comment 19 Brandi Munilla 2018-09-07 16:47:00 UTC 
Thank you!
Comment 20 Brandi Munilla 2018-09-25 15:38:43 UTC 
Documentation updated: https://access.redhat.com/documentation/en-us/openshift_container_platform/3.9/html-single/installation_and_configuration/#aggregated-fluentd