Bug 2026431 - Alerts: SSPDown and SSPTemplateValidatorDown are constantly in Firing state
Summary: Alerts: SSPDown and SSPTemplateValidatorDown are constantly in Firing state
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Container Native Virtualization (CNV)
Classification: Red Hat
Component: SSP
Version: 4.9.1
Hardware: Unspecified
OS: Unspecified
urgent
urgent
Target Milestone: ---
: 4.9.1
Assignee: Boriso
QA Contact: Roni Kishner
URL:
Whiteboard:
Depends On:
Blocks: 2026667
TreeView+ depends on / blocked
 
Reported: 2021-11-24 16:04 UTC by Denys Shchedrivyi
Modified: 2021-12-13 19:59 UTC (History)
6 users (show)

Fixed In Version: kubevirt-ssp-operator-container-v4.9.1-5
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
: 2026667 (view as bug list)
Environment:
Last Closed: 2021-12-13 19:59:01 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github kubevirt ssp-operator pull 259 0 None open Fix Alerts firing, metrics missing bug 2021-11-26 06:52:39 UTC
Github kubevirt ssp-operator pull 260 0 None Merged [release-v0.12] Fix Alerts firing, metrics missing bug 2021-11-26 10:34:29 UTC
Red Hat Bugzilla 2008166 1 high CLOSED Recording Rules which uses "up" metrics showing incorrect output. 2021-12-13 19:59:17 UTC
Red Hat Product Errata RHBA-2021:5091 0 None None None 2021-12-13 19:59:15 UTC

Description Denys Shchedrivyi 2021-11-24 16:04:56 UTC
Description of problem:
 There are 2 SSP alerts (SSPDown and SSPTemplateValidatorDown) are constantly in firing state right after cluster installation

Metrics kubevirt_ssp_template_validator_up_total and kubevirt_ssp_operator_up_total show 0


However pods are active and in Running state:

$ oc get pod -n openshift-cnv | egrep "ssp|template"
ssp-operator-6557957df8-p7rhb                          1/1     Running   6 (21h ago)   38h
virt-template-validator-5dc6645f69-5q92b               1/1     Running   0             38h
virt-template-validator-5dc6645f69-x57g5               1/1     Running   0             38h



Version-Release number of selected component (if applicable):
4.9.1

Steps to Reproduce:
1. install cnv
2. wait 5-10 minutes
3. check alerts

Actual results:
SSPDown and SSPTemplateValidatorDown alerts are constantly in firing state

Expected results:
Alerts should fire only when SSP PODs are not active

Additional info:

Comment 1 Roni Kishner 2021-11-28 11:22:54 UTC
Validated on version: 4.9.1-5 of ssp-operator

The alerts aren't showing when when all in running stage.
To make sure this is fixed
i scaled down the validators pods to 0. the alert was showing, and then when i scaled it back to 2 the alert was gone. same was done to ssp-operator

Comment 7 errata-xmlrpc 2021-12-13 19:59:01 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Virtualization 4.9.1 Images), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:5091


Note You need to log in before you can comment on or make changes to this bug.