Bug 1888420

Summary: Collectors are missing metric for input sources
Product: OpenShift Container Platform Reporter: Jeff Cantrill <jcantril>
Component: LoggingAssignee: Jeff Cantrill <jcantril>
Status: CLOSED ERRATA QA Contact: Anping Li <anli>
Severity: medium Docs Contact:
Priority: unspecified    
Version: 4.6CC: aos-bugs, periklis
Target Milestone: ---   
Target Release: 4.7.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard: logging-core
Fixed In Version: Doc Type: No Doc Update
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-02-24 11:21:19 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1896166    

Description Jeff Cantrill 2020-10-14 19:49:17 UTC
Description of problem:

Logging collectors do not provide input metrics to provide information at point of collection

Comment 1 Jeff Cantrill 2020-10-23 15:20:17 UTC
Setting UpcomingSprint as unable to resolve before EOD

Comment 3 Anping Li 2020-11-19 14:48:20 UTC
Verified on clusterlogging.4.7.0-202011142142.p0

Comment 6 Anping Li 2021-01-29 15:32:31 UTC
Verified on
clusterserviceversion.operators.coreos.com/clusterlogging.4.6.0-202101290552.p0
clusterserviceversion.operators.coreos.com/elasticsearch-operator.4.6.0-202101290552.p0

#curl -k -H "Authorization: Bearer `oc sa get-token prometheus-k8s -n openshift-monitoring`" -H "Content-type: application/json" https://$fluentd_svc//metrics |grep input_record
....
cluster_logging_collector_input_record_total{tag="kubernetes.var.log.containers.prometheus-k8s-1_openshift-monitoring_prometheus-2f18b4c3f374f98ba4b024a06cfb38a4fe3267fd09a10c93ad77fbf9250516c1.log",hostname="fluentd-kpvbt"} 140.0
cluster_logging_collector_input_record_total{tag="journal",hostname="fluentd-kpvbt"} 28218.0
# TYPE cluster_logging_collector_input_record_bytes counter
# HELP cluster_logging_collector_input_record_bytes The total bytes of incoming records
cluster_logging_collector_input_record_bytes{tag="kubernetes.var.log.containers.machine-config-daemon-qrplz_openshift-machine-config-operator_machine-config-daemon-2edaa234bb68e6ea6cab0293a90d9cda0d0463882e39ae9f793356b87fb70200.log",hostname="fluentd-kpvbt"} 30767.0
cluster_logging_collector_input_record_bytes{tag="kubernetes.var.log.containers.aws-ebs-csi-driver-node-4m54l_openshift-cluster-csi-drivers_csi-driver-b315b33e7e0e49b5f81ea2e8ad6d3b2ac2aa69389f773f72271c99f6a04eeca5.log",hostname="fluentd-kpvbt"} 1186.0
....

Comment 9 errata-xmlrpc 2021-02-24 11:21:19 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Errata Advisory for Openshift Logging 5.0.0), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:0652