Bug 1534588
| Summary: | Size of the emitted data exceeds buffer_chunk_limit [OCP 3.5] | ||
|---|---|---|---|
| Product: | OpenShift Container Platform | Reporter: | Sebastien Aime <saime> |
| Component: | Logging | Assignee: | Noriko Hosoi <nhosoi> |
| Status: | CLOSED INSUFFICIENT_DATA | QA Contact: | Anping Li <anli> |
| Severity: | low | Docs Contact: | |
| Priority: | high | ||
| Version: | 3.5.0 | CC: | aos-bugs, ewolinet, fcami, jcantril, jeder, lvlcek, mifiedle, misalunk, nhosoi, nkinder, pportant, rmeggins, saime, vlaad, wsun |
| Target Milestone: | --- | ||
| Target Release: | 3.6.z | ||
| Hardware: | x86_64 | ||
| OS: | Linux | ||
| Whiteboard: | aos-scalability-34 | ||
| Fixed In Version: | Doc Type: | If docs needed, set a value | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | 1413147 | Environment: | |
| Last Closed: | 2018-08-13 12:23:33 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
| Bug Depends On: | 1413147, 1469859 | ||
| Bug Blocks: | |||
Francois could you please attache some additional information about the logging env: * ES DC/Pod yaml * Fluentd DS/pod yml * ES PV and disk size and info * Any info regarding the infra nodes hosting the ES and Fluent pods so we might better understand the disk and network IO * Provide data about the number of primary shards * The number of pending tasks over time A script that may be of interest: https://gist.githubusercontent.com/portante/c801acce8ae275fdcfc743b346981b13/raw/45cff354ec4a96882f6abc0725b2b6a646c5003c/health.sh Commits pushed to master at https://github.com/openshift/origin-aggregated-logging https://github.com/openshift/origin-aggregated-logging/commit/a24301bb9ae6bdfe3bca934a24c79ed68b1e8164 Bug 1534588 - Size of the emitted data exceeds buffer_chunk_limit If secure-forward outputs are additionally configured, the output count is also to be added to NUM_OUTPUTS, which is a divider to calculate the buffer size per output. Adding tests to cover the cases - having 1 then 2 intermediate forwarding fluentds. https://github.com/openshift/origin-aggregated-logging/commit/d5cd715df125f404af6f41a430b0a7fa42a9fb16 Merge pull request #926 from nhosoi/bz1534588 Automatic merge from submit-queue. Bug 1534588 - Size of the emitted data exceeds buffer_chunk_limit If secure-forward outputs are additionally configured, the output count is also to be added to NUM_OUTPUTS, which is a divider to calculate the buffer size per output. Adding tests to cover the cases - having 1 then 2 intermediate forwarding fluentds. Commit pushed to master at https://github.com/openshift/origin-aggregated-logging https://github.com/openshift/origin-aggregated-logging/commit/2d6b6043c2707d461d5a6eb8e38520d496c329f3 Removing an unnecessary line from the rebase mistake in pr/#926. Bug 1534588 - Size of the emitted data exceeds buffer_chunk_limit Commits pushed to master at https://github.com/openshift/origin-aggregated-logging https://github.com/openshift/origin-aggregated-logging/commit/6004e364013c333b445bda318cc599ac6a37ad00 Bug 1534588 - Size of the emitted data exceeds buffer_chunk_limit If secure-forward outputs are additionally configured, the output count is also to be added to NUM_OUTPUTS, which is a divider to calculate the buffer size per output. Adding tests to cover the cases - having 1 then 2 intermediate forwarding fluentds. https://github.com/openshift/origin-aggregated-logging/commit/9c429de93b8121f0854e3ee11079f86a3e145a30 Merge pull request #941 from openshift-cherrypick-robot/cherry-pick-926-to-es5.x [es5.x] Bug 1534588 - Size of the emitted data exceeds buffer_chunk_limit |
Created attachment 1382428 [details] graphs generated after having set BUFFER_SIZE_LIMIT to 8MB