Bug 2086495

Summary: After upgrading OCS cluster from 4.8 to ODF 4.9 multiple duplicate alerts
Product: [Red Hat Storage] Red Hat OpenShift Data Foundation Reporter: aharchin
Component: ceph-monitoringAssignee: Pranshu Srivastava <prasriva>
Status: CLOSED CURRENTRELEASE QA Contact: Harish NV Rao <hnallurv>
Severity: low Docs Contact:
Priority: unspecified    
Version: 4.8CC: hekumar, muagarwa, nthomas, ocs-bugs, odf-bz-bot, prasriva
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2022-11-02 07:17:46 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description aharchin 2022-05-16 10:36:00 UTC
Description of problem: 

After upgrading OCS cluster from 4.8 to ODF 4.9 multiple duplicate alerts:

While checking able to see multiple prometheus rules:

~~~
#  oc get prometheusrule -n openshift-storage
NAME                        AGE
noobaa-prometheus-rules     152d
ocs-prometheus-rules        152d
prometheus-ceph-v14-rules   152d
prometheus-ceph-v16-rules   89d
~~~


Rule `prometheus-ceph-v14-rules` and `prometheus-ceph-v16-rules` are having almost same alerts. Which seems to be the cause of duplicate alerts.


After deleting `prometheus-ceph-v14-rules` duplicate alerts vanished and operator did not reconcile the prometheus rule again.

Version-Release number of selected component (if applicable):

After upgrading OCS cluster from 4.8 to ODF 4.9 

Actual results: Duplicate alerts


Expected results: Operator should delete the old prometheusrule `prometheus-ceph-v14-rules`.



Additional info: Attaching cluster and storage mustgather for reference.