.Active alert displays even when Prometheus module is active
In some cases, the Ceph Dashboard shows an active alert for `CephMgrPrometheusModuleInactive` even though the Prometheus module is enabled. This can happen due to a cluster misconfiguration that causes the Ceph target to go down, falsely triggering the alert.
The alert remains visible unless silenced, even when the Prometheus module is functioning correctly.
As a workaround, to suppress the alert, from the Ceph Dashboard, select the `CephMgrPrometheusModuleInactive` alert and create a silence.
*Observability -> Alerts → CephMgrPrometheusModuleInactive → Create Silence.*
For more information, see Managing alerts.
Created attachment 1957817[details]
Check_active_alert_prometheus_img1
Description of problem:
========================
On Ceph Dashboard, even if the Prometheus module is active, an active alert is displayed saying that the mgr/prometheus module is not available
Version-Release number of selected component (if applicable):
=============================================================
ceph version 17.2.6-21.el9cp (9ca345dbaedb31f7b7ef0435c8e6b3f811bbcb19) quincy (stable)
How reproducible:
=================
Always
Steps to Reproduce:
===================
1. Deploy a RHCS 6.1 cluster with dashboard enabled
2. Login to Dashboard >> Cluster >> Active Alerts
3. From CLI, run the command "ceph mgr module ls"
4. From Ceph Dashboard >> go to Cluster >> Manager Modules >> search for Prometheus
Actual results:
===============
1) Active alert for "CephMgrPrometheusModuleInactive" is displayed (check the attached screenshot)
2) From CLI-
[ceph: root@ceph-saraut-6-1-ickncj-node1-installer /]# ceph mgr module ls
MODULE
balancer on (always on)
crash on (always on)
devicehealth on (always on)
orchestrator on (always on)
pg_autoscaler on (always on)
progress on (always on)
rbd_support on (always on)
status on (always on)
telemetry on (always on)
volumes on (always on)
cephadm on
dashboard on
iostat on
nfs on
prometheus on
restful on
alerts -
influx -
3) After checking the Prometheus module status from Ceph Dashboard >> Cluster >> Manager Modules >> Prometheus ; it is displayed as enabled (check the attached screenshot)
Expected results:
=================
As the Prometheus module is enabled and running, the alert should NOT be displayed.
Created attachment 1957817 [details] Check_active_alert_prometheus_img1 Description of problem: ======================== On Ceph Dashboard, even if the Prometheus module is active, an active alert is displayed saying that the mgr/prometheus module is not available Version-Release number of selected component (if applicable): ============================================================= ceph version 17.2.6-21.el9cp (9ca345dbaedb31f7b7ef0435c8e6b3f811bbcb19) quincy (stable) How reproducible: ================= Always Steps to Reproduce: =================== 1. Deploy a RHCS 6.1 cluster with dashboard enabled 2. Login to Dashboard >> Cluster >> Active Alerts 3. From CLI, run the command "ceph mgr module ls" 4. From Ceph Dashboard >> go to Cluster >> Manager Modules >> search for Prometheus Actual results: =============== 1) Active alert for "CephMgrPrometheusModuleInactive" is displayed (check the attached screenshot) 2) From CLI- [ceph: root@ceph-saraut-6-1-ickncj-node1-installer /]# ceph mgr module ls MODULE balancer on (always on) crash on (always on) devicehealth on (always on) orchestrator on (always on) pg_autoscaler on (always on) progress on (always on) rbd_support on (always on) status on (always on) telemetry on (always on) volumes on (always on) cephadm on dashboard on iostat on nfs on prometheus on restful on alerts - influx - 3) After checking the Prometheus module status from Ceph Dashboard >> Cluster >> Manager Modules >> Prometheus ; it is displayed as enabled (check the attached screenshot) Expected results: ================= As the Prometheus module is enabled and running, the alert should NOT be displayed.