Description of problem:
During cnv upgrade v4.12.4 to 4.12.5-50 (OCP: 4.12.26), noticed SSPCommonTemplatesModificationReverted (SSP operator) alert in firing state.


Version-Release number of selected component (if applicable):
cnv: 4.12.4 to 4.12.5-50  (OCP: 4.12.26)

How reproducible:
1 out of 1 attempt 

Steps to Reproduce:
1. Check alerts fired during cnv upgrade
2.
3.

Actual results:
[{'labels': {'alertname': 'SSPCommonTemplatesModificationReverted', 'kubernetes_operator_component': 'ssp-operator', 'kubernetes_operator_part_of': 'kubevirt', 'severity': 'warning'}, 'annotations': {'runbook_url': 'https://kubevirt.io/monitoring/runbooks/SSPCommonTemplatesModificationReverted', 'summary': 'Common Templates manual modifications were reverted by the operator'}, 'state': 'firing', 'activeAt': '2023-07-26T20:49:22.832759694Z', 'value': '1.1266666666666666e+02'}

Expected results:
we are trying to capture all the alerts that are fired during upgrades and reduce the noise generated.


Additional info:

http://pastebin.test.redhat.com/1106300

must-gather.log
http://pastebin.test.redhat.com/1106301