Bug 1894639 - Fluent stops sending logs even though logging stack seems functional
Summary: Fluent stops sending logs even though logging stack seems functional
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Logging
Version: 4.6
Hardware: Unspecified
OS: Unspecified
unspecified
medium
Target Milestone: ---
: 4.6.z
Assignee: Jeff Cantrill
QA Contact: Anping Li
URL:
Whiteboard: logging-core
Depends On: 1894634
Blocks: 1894640
TreeView+ depends on / blocked
 
Reported: 2020-11-04 16:56 UTC by Jeff Cantrill
Modified: 2021-02-08 13:41 UTC (History)
3 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Cause: The max backoff time was too long if and endpoint was down Consequence: Logs were not shipped to an endpoint for an extended period of time even when an endpiont came backup Fix: Lower the max backoff time Result: Logs are shipped sooner.
Clone Of: 1894634
: 1894640 (view as bug list)
Environment:
Last Closed: 2021-02-08 13:41:41 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github openshift cluster-logging-operator pull 799 0 None closed Bug 1894634: lower default max_retry_wait 2021-02-08 23:48:54 UTC
Github openshift cluster-logging-operator pull 800 0 None closed Bug 1894639: lower default max_retry_wait 2021-02-08 23:48:54 UTC
Red Hat Product Errata RHSA-2021:0310 0 None None None 2021-02-08 13:41:57 UTC

Description Jeff Cantrill 2020-11-04 16:56:42 UTC 
+++ This bug was initially created as a clone of Bug #1894634 +++

Description of problem:
Fluent seems functional but is not shipping logs and it has a log entry of:

failed to write data into buffer by buffer overflow action=:block

Once the pods are restarted logs start flowing again

Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

failed to write data into buffer by buffer overflow action=:block

--- Additional comment from Jeff Cantrill on 2020-11-04 16:55:22 UTC ---

This is modifiable via changes to CL api https://issues.redhat.com/browse/LOG-742
Comment 1 Jeff Cantrill 2020-11-04 16:57:29 UTC 
This is modifiable via changes to CL api https://issues.redhat.com/browse/LOG-742
Comment 2 Jeff Cantrill 2020-11-18 20:43:55 UTC 
Reopen to modify defaults
Comment 5 Anping Li 2021-02-02 08:14:24 UTC 
Verified on clusterlogging.4.6.0-202101301510.p0
Comment 7 errata-xmlrpc 2021-02-08 13:41:41 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: OpenShift Container Platform 4.6.16 extras security update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2021:0310
Note You need to log in before you can comment on or make changes to this bug.