Bug 1686946
| Summary: | Allow MERGE_JSON_LOG=true for indexing of JSON payload fields | |||
|---|---|---|---|---|
| Product: | OpenShift Container Platform | Reporter: | Rich Megginson <rmeggins> | |
| Component: | Logging | Assignee: | Rich Megginson <rmeggins> | |
| Status: | CLOSED ERRATA | QA Contact: | Anping Li <anli> | |
| Severity: | unspecified | Docs Contact: | ||
| Priority: | unspecified | |||
| Version: | 3.10.0 | CC: | anli, aos-bugs, ddelcian, jcantril, jgoulding, pstrick, qitang, rmeggins, smunilla | |
| Target Milestone: | --- | Flags: | smunilla:
needinfo-
|
|
| Target Release: | 3.10.z | |||
| Hardware: | Unspecified | |||
| OS: | Unspecified | |||
| Whiteboard: | ||||
| Fixed In Version: | openshift3/logging-fluentd:v3.10.126-1 | Doc Type: | Bug Fix | |
| Doc Text: |
Cause: Using MERGE_JSON_LOG=true can create fields in the
record which will cause schema and syntax violations in
Elasticsearch. It can also create too many fields for
Elasticsearch to handle without severe performance problems.
Consequence: Fluentd reports error 400 sending records to
Elasticsearch. Elasticsearch performance degrades.
Fix: Allow users who experience these problems to tune their
Fluentd to accomodate their log record fields.
Result: Logs are ingested into Fluentd with no errors.
Elasticsearch performance does not degrade.
|
Story Points: | --- | |
| Clone Of: | 1685243 | |||
| : | 1686947 (view as bug list) | Environment: | ||
| Last Closed: | 2019-04-09 23:40:44 UTC | Type: | --- | |
| Regression: | --- | Mount Type: | --- | |
| Documentation: | --- | CRM: | ||
| Verified Versions: | Category: | --- | ||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | ||
| Cloudforms Team: | --- | Target Upstream Version: | ||
| Embargoed: | ||||
| Bug Depends On: | 1685243 | |||
| Bug Blocks: | 1686947 | |||
|
Comment 1
Rich Megginson
2019-03-12 18:20:22 UTC
merged upstream https://github.com/openshift/origin-aggregated-logging/commit/02dd621fa3add25c6c686994be211faa64f72140 The fix is implemented in rubygem-fluent-plugin-viaq_data_model-0.0.18-1.el7 - please verify that the fluentd image has this version (or later). Move to Modified status. as the bug isn't fix in the release package v3.10.127-1. list in https://errata.devel.redhat.com/advisory/40290 The fix works well on fluentd:v3.10.127 Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2019:0620 |