Bug 1588827

Summary: After upgrade to 3.6 some logs are not showing in the Kibana webUI
Product: OpenShift Container Platform Reporter: Rich Megginson <rmeggins>
Component: LoggingAssignee: Rich Megginson <rmeggins>
Status: CLOSED ERRATA QA Contact: Anping Li <anli>
Severity: urgent Docs Contact:
Priority: urgent    
Version: 3.7.1CC: anli, aos-bugs, jfoots, rmeggins
Target Milestone: ---   
Target Release: 3.7.z   
Hardware: All   
OS: Linux   
Whiteboard:
Fixed In Version: logging-fluentd-container-v3.7.53-1 Doc Type: Bug Fix
Doc Text:
Cause: The incoming data has a field `record["event"]` that is a String value and not the Hash value expected by the transform_eventrouter code. Consequence: This causes the code to throw an error and fluentd to emit an error like this: ``` error_class=NoMethodError error="undefined method `key?' for \"request\":String" ``` Fix: The transform_eventrouter code has been changed to only process the `record["event"]` field if it is a Hash. Result: Records can flow through to Elasticsearch again.
 Story Points: ---
Clone Of: 1588772
: 1588828 (view as bug list) Environment:
Last Closed: 2018-06-27 07:59:11 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1588772    
Bug Blocks: 1588828, 1588829    

Comment 2 Anping Li 2018-06-21 06:38:00 UTC 
The string event message can be sent to ES with openshift3/logging-fluentd/images/v3.7.55-1"


 {
      "_index" : ".operations.2018.06.21",
      "_type" : "com.redhat.viaq.common",
      "_id" : "ODYwNzViMDYtODQ1MS00YjBlLWFiYzEtZjMwZGJkMzNlNmJi",
      "_score" : 14.289303,
      "_source" : {
        "event" : "anlieventevent",
        "verb" : "ADDED",
        "docker" : {
          "container_id" : "e99108e3e5ed6a4fc476538df4928e3bd5168c38e5087c20bee1cc2e5e571d45"
        },
         <---snip---->
         <---snip---->
        "level" : "info",
        "message" : "{ \"event\": \"anlieventevent\", \"verb\": \"ADDED\" }\r",
        "hostname" : "ip-172-18-1-12.ec2.internal",
Comment 4 errata-xmlrpc 2018-06-27 07:59:11 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2018:2009