Bug 2004478 - MGR related alerts are not working
Summary: MGR related alerts are not working
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Red Hat OpenShift Container Storage
Classification: Red Hat Storage
Component: odf-managed-service
Version: 4.8
Hardware: Unspecified
OS: Unspecified
high
urgent
Target Milestone: ---
: ---
Assignee: Dhruv Bindra
QA Contact: Filip Balák
URL:
Whiteboard:
Depends On: 2006323
Blocks:
TreeView+ depends on / blocked
 
Reported: 2021-09-15 12:21 UTC by Filip Balák
Modified: 2021-12-16 19:49 UTC (History)
5 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2021-12-16 19:49:18 UTC
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github openshift ocs-osd-deployer pull 94 0 None open AlertRelabelConfigSecret added to apply namespace label to alerts 2021-10-04 13:34:27 UTC
Red Hat Bugzilla 1998056 1 high CLOSED Alerts CephMgrIsAbsent and CephMgrIsMissingReplicas are triggered right after installation 2022-05-26 08:04:48 UTC
Red Hat Bugzilla 2005290 1 high CLOSED namespace: openshift-storage label missing for few OCS alerts 2023-08-09 16:37:41 UTC

Internal Links: 2005290 2033284

Description Filip Balák 2021-09-15 12:21:16 UTC 
Description of problem:
When Ceph MGR is missing, there is no alert sent to PagerDuty.

Version-Release number of selected component (if applicable):
ocs-operator.v4.8.1
ocs-osd-deployer-qe.v1.1.0

How reproducible:
2/2

Steps to Reproduce:
1. Scale deployment of rook-ceph-mgr-a to 0.
2. Check PagerDuty system

Actual results:
No alert is sent within 10 minutes

Expected results:
Alert is sent according to alerting rule (after 5 minutes)

Additional info:
Tested on ROSA cluster.
Comment 1 Filip Balák 2021-12-14 15:17:25 UTC 
Alert is propagated correctly and when the deployment is up again, the alert is cleared correctly. --> VERIFIED

Tested with:
ocs-operator.v4.8.5
ocs-osd-deployer-qe.v1.1.2
ocp 4.9.9
Note You need to log in before you can comment on or make changes to this bug.