Bug 1644686 - Increased file i/o using experimental logging-fluentd based on 1.2.x
Summary: Increased file i/o using experimental logging-fluentd based on 1.2.x
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Logging
Version: 4.1.0
Hardware: x86_64
OS: Linux
medium
low
Target Milestone: ---
: 4.2.0
Assignee: Jeff Cantrill
QA Contact: Mike Fiedler
URL:
Whiteboard: aos-scalability-40
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2018-10-31 12:09 UTC by Mike Fiedler
Modified: 2019-10-16 06:27 UTC (History)
3 users (show)

Fixed In Version:
Doc Type: No Doc Update
Doc Text:
Clone Of:
Environment:
Last Closed: 2019-10-16 06:27:40 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)
Decreased IOPS after new fluentd version used. (125.80 KB, image/png)
2019-09-20 04:04 UTC, Mike Fiedler
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Github openshift origin-aggregated-logging pull 1736 0 'None' closed Bug 1644686: Increased file i/o using experimental logging-fluentd based on 1.2.x 2020-11-09 07:35:25 UTC
Red Hat Product Errata RHBA-2019:2922 0 None None None 2019-10-16 06:27:56 UTC

Description Mike Fiedler 2018-10-31 12:09:33 UTC
Description of problem:

This is a tracker for https://github.com/fluent/fluentd/issues/2153.   A place to discuss any possible actions on the OpenShift side (changes to tagging, event streams, etc) or provide additional results beyond what is already in the issue

Version-Release number of selected component (if applicable): OCP 4.0

Comment 3 Mike Fiedler 2019-08-22 11:18:37 UTC
Claimed fixed upstream in fluentd 1.7.   See closing comment in https://github.com/fluent/fluentd/issues/2153

Comment 6 Mike Fiedler 2019-09-20 03:20:55 UTC
Verified on fluentd v4.2.0-201909162219.

Logging 3000 1Kb messages/second across 20 namespaces on a fluentd - no message loss and IOPS averaged 65 read and 39 write over the course of the run  vs the ~1000 write IOPS seen in the original issue.

Comment 7 Mike Fiedler 2019-09-20 04:04:57 UTC
Created attachment 1617016 [details]
Decreased IOPS after new fluentd version used.

Comment 9 errata-xmlrpc 2019-10-16 06:27:40 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2019:2922


Note You need to log in before you can comment on or make changes to this bug.