Created attachment 1314718 [details]
config info

Description of problem:

2017-08-17 12:34:09 +0000 [error]: Exception emitting record: "\x92" from ASCII-8BIT to UTF-8
2017-08-17 12:34:09 +0000 [warn]: emit transaction failed: error_class=Encoding::UndefinedConversionError error="\"\\x92\" from ASCII-8BIT to UTF-8" tag="kubernetes.journal.container.fluentd"
  2017-08-17 12:34:09 +0000 [warn]: suppressed same stacktrace
2017-08-17 12:34:09 +0000 [warn]: emit transaction failed: error_class=Encoding::UndefinedConversionError error="\"\\x92\" from ASCII-8BIT to UTF-8" tag="journal"
  2017-08-17 12:34:09 +0000 [warn]: suppressed same stacktrace
2017-08-17 12:34:09 +0000 [error]: Exception emitting record: "\x92" from ASCII-8BIT to UTF-8
2017-08-17 12:34:09 +0000 [warn]: emit transaction failed: error_class=Encoding::UndefinedConversionError error="\"\\x92\" from ASCII-8BIT to UTF-8" tag="kubernetes.journal.container.fluentd"
  2017-08-17 12:34:09 +0000 [warn]: suppressed same stacktrace
2017-08-17 12:34:09 +0000 [warn]: emit transaction failed: error_class=Encoding::UndefinedConversionError error="\"\\x92\" from ASCII-8BIT to UTF-8" tag="journal"
  2017-08-17 12:34:09 +0000 [warn]: suppressed same stacktrace
2017-08-17 12:34:09 +0000 [error]: Exception emitting record: "\x92" from ASCII-8BIT to UTF-8
2017-08-17 12:34:09 +0000 [warn]: emit transaction failed: error_class=Encoding::UndefinedConversionError error="\"\\x92\" from ASCII-8BIT to UTF-8" tag="kubernetes.journal.container.fluentd"
  2017-08-17 12:34:09 +0000 [warn]: suppressed same stacktrace


Version-Release number of selected component (if applicable):    Logging 3.6.0.75


How reproducible:  Always


Steps to Reproduce:
1.  Install logging 3.6.173.0.5 on an AWS cluster (inventory is below)
2.  oc logs <fluentd pod>


Actual results:

Hundreds of thousands of the message above

Expected results:

Quiet fluentd logs on an idle cluster

Additional info:

OpenShift Cluster Details

Cluster version (e.g. OCP v3.5)
3.6.173.0.5
Cluster infrastructure (e.g. AWS, GCP)
AWS
Number of infrastructure nodes and size (e.g. CPU, RAM)
2 - m4.xlarge 4vcpu/16GB
Number of compute nodes and size (e.g. CPU, RAM)
2 - m4.xlarge
Logging Image versions
3.6.173.0.5


Installer Details

How was logging installed (e.g. Openshift Ansible/Installer, deployer)
Ansible

Openshift installer version
openshift-ansible.noarch        3.6.173.0.5-1.git.0.74d5acc.el7

Ansible inventory file
[oo_first_master]
ip-172-31-24-12

[oo_first_master:vars]
openshift_deployment_type=openshift-enterprise
openshift_release=v3.6.0

openshift_logging_install_logging=true
openshift_logging_use_ops=false
openshift_logging_master_url=https://ec2-54-213-226-170.us-west-2.compute.amazonaws.com:8443
openshift_logging_master_public_url=https://ec2-54-213-226-170.us-west-2.compute.amazonaws.com:8443
openshift_logging_kibana_hostname=kibana.0817-3qk.qe.rhcloud.com 
openshift_logging_kibana_ops_hostname=kibana-ops.0817-3qk.qe.rhcloud.com 
openshift_logging_namespace=logging
openshift_logging_image_prefix=registry.ops.openshift.com/openshift3/
openshift_logging_image_version=v3.6.173.0.5
openshift_logging_es_pvc_dynamic=true
openshift_logging_es_pvc_size=50Gi
openshift_logging_fluentd_use_journal=true
openshift_logging_use_mux=false
openshift_logging_use_mux_client=false
openshift_logging_es_ops_allow_cluster_reader=true
openshift_logging_es_ops_pvc_dynamic=true
openshift_logging_es_ops_pvc_size=50Gi
#openshift_logging_fluentd_journal_read_f


Ansible installer logs
N/A - no errors though

Logging Component Details


Fluentd spec: oc get ds logging-fluentd -o yaml
attached

Configmaps: oc get configmaps $CONFIGMAP -o yaml
attached

Events: oc get events $PODNAME -o yaml
attached