Created attachment 1488081 [details] Output from both command when reproducing the issue. Showing indices available in elasticsearch and metrics exported Description of problem: Running `atomic-openshift-3.10.14-1.git.0.ba8ae6d.el7.x86_64` with registry.access.redhat.com/openshift3/logging-elasticsearch:v3.10.14 is failing to export per indice metrics. As per https://github.com/vvanholl/elasticsearch-prometheus-exporter the exporter should actually include per indice metrics, but as shown in the attached file no data related to the specific indices can be found Version-Release number of selected component (if applicable): - atomic-openshift-3.10.14-1.git.0.ba8ae6d.el7.x86_64 How reproducible: - Always Steps to Reproduce: 1. Install Prometheus according https://docs.openshift.com/container-platform/3.10/install_config/cluster_metrics.html#openshift-prometheus-deploy 2. Deploy EFK stack as per https://docs.openshift.com/container-platform/3.10/install_config/aggregate_logging.html#deploying-the-efk-stack 3. Check indices available in `elasticsearch` with `oc exec $es_pod -- curl -s -k --cert /etc/elasticsearch/secret/admin-cert --key /etc/elasticsearch/secret/admin-key https://logging-es:9200/_cat/indices?v` 4. Check Metrics reported by `elasticsearch` exporter: `curl -k -H "Authorization: Bearer $(oc sa get-token prometheus -n openshift-metrics)" https://<es-pod-ip>:4443/_prometheus/metrics` Actual results: No indice related metrics available/reported Expected results: Per indice metrics reported in order to use them further for charging, planning and monitoring purpose Additional info:
Changing this to the logging team as Prometheus just collects whatever the exporter gives it, and this seems to have shown already that the exporter is indeed not exporting the metrics.
Indices level metrics are back in Prometheus exporter plugin. See https://github.com/vvanholl/elasticsearch-prometheus-exporter/pull/131 Next step is to upgrade to relevant ES plugin to have it in OpenShift logging.
Closing CURRENTRELEASE as fixed in 3.11 and later. Prior versions are based on earlier versions of Elasticsearch which we are moving away from.