Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1845369

Summary: Resume a cluster from sleep, Alerts keep firing even though everything is fine
Product: OpenShift Container Platform Reporter: OpenShift BugZilla Robot <openshift-bugzilla-robot>
Component: NodeAssignee: Ryan Phillips <rphillips>
Status: CLOSED ERRATA QA Contact: Sunil Choudhary <schoudha>
Severity: urgent Docs Contact:
Priority: unspecified    
Version: 4.5CC: alegrand, anpicker, aos-bugs, deads, erooth, jokerman, kakkoyun, lcosic, mloibl, nagrawal, pkrupa, rphillips, surbania, tnozicka, vareti
Target Milestone: ---Keywords: UpcomingSprint
Target Release: 4.5.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2020-07-13 17:43:40 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1839098    
Bug Blocks:    

Comment 6 Sunil Choudhary 2020-06-22 10:21:23 UTC
Verified on 4.5.0-0.nightly-2020-06-20-194346. Stopped cluster for 24 hours by stopping VMs from AWS console. Started after 24 hours, approved CSRs and waited for 15-20 minutes. Do not see any Down alerts from console.

$ oc get clusterversion
NAME      VERSION                             AVAILABLE   PROGRESSING   SINCE   STATUS
version   4.5.0-0.nightly-2020-06-20-194346   True        False         26h     Cluster version is 4.5.0-0.nightly-2020-06-20-194346

$ oc get co
NAME                                       VERSION                             AVAILABLE   PROGRESSING   DEGRADED   SINCE
authentication                             4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
cloud-credential                           4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
cluster-autoscaler                         4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
config-operator                            4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
console                                    4.5.0-0.nightly-2020-06-20-194346   True        False         False      23m
csi-snapshot-controller                    4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
dns                                        4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
etcd                                       4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
image-registry                             4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
ingress                                    4.5.0-0.nightly-2020-06-20-194346   True        False         False      23m
insights                                   4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
kube-apiserver                             4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
kube-controller-manager                    4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
kube-scheduler                             4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
kube-storage-version-migrator              4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
machine-api                                4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
machine-approver                           4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
machine-config                             4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
marketplace                                4.5.0-0.nightly-2020-06-20-194346   True        False         False      25m
monitoring                                 4.5.0-0.nightly-2020-06-20-194346   True        False         False      23m
network                                    4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
node-tuning                                4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
openshift-apiserver                        4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
openshift-controller-manager               4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
openshift-samples                          4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
operator-lifecycle-manager                 4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
operator-lifecycle-manager-catalog         4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
operator-lifecycle-manager-packageserver   4.5.0-0.nightly-2020-06-20-194346   True        False         False      20m
service-ca                                 4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h
storage                                    4.5.0-0.nightly-2020-06-20-194346   True        False         False      26h

$ oc get nodes -o wide
NAME                                         STATUS   ROLES    AGE   VERSION           INTERNAL-IP    EXTERNAL-IP   OS-IMAGE                                                       KERNEL-VERSION                CONTAINER-RUNTIME
ip-10-0-137-200.us-east-2.compute.internal   Ready    worker   26h   v1.18.3+1b98519   10.0.137.200   <none>        Red Hat Enterprise Linux CoreOS 45.82.202006201629-0 (Ootpa)   4.18.0-193.9.1.el8_2.x86_64   cri-o://1.18.2-15.dev.rhaos4.5.git7c4494f.el8
ip-10-0-156-81.us-east-2.compute.internal    Ready    master   26h   v1.18.3+1b98519   10.0.156.81    <none>        Red Hat Enterprise Linux CoreOS 45.82.202006201629-0 (Ootpa)   4.18.0-193.9.1.el8_2.x86_64   cri-o://1.18.2-15.dev.rhaos4.5.git7c4494f.el8
ip-10-0-177-137.us-east-2.compute.internal   Ready    master   26h   v1.18.3+1b98519   10.0.177.137   <none>        Red Hat Enterprise Linux CoreOS 45.82.202006201629-0 (Ootpa)   4.18.0-193.9.1.el8_2.x86_64   cri-o://1.18.2-15.dev.rhaos4.5.git7c4494f.el8
ip-10-0-190-200.us-east-2.compute.internal   Ready    worker   26h   v1.18.3+1b98519   10.0.190.200   <none>        Red Hat Enterprise Linux CoreOS 45.82.202006201629-0 (Ootpa)   4.18.0-193.9.1.el8_2.x86_64   cri-o://1.18.2-15.dev.rhaos4.5.git7c4494f.el8
ip-10-0-192-158.us-east-2.compute.internal   Ready    worker   26h   v1.18.3+1b98519   10.0.192.158   <none>        Red Hat Enterprise Linux CoreOS 45.82.202006201629-0 (Ootpa)   4.18.0-193.9.1.el8_2.x86_64   cri-o://1.18.2-15.dev.rhaos4.5.git7c4494f.el8
ip-10-0-213-239.us-east-2.compute.internal   Ready    master   26h   v1.18.3+1b98519   10.0.213.239   <none>        Red Hat Enterprise Linux CoreOS 45.82.202006201629-0 (Ootpa)   4.18.0-193.9.1.el8_2.x86_64   cri-o://1.18.2-15.dev.rhaos4.5.git7c4494f.el8

Comment 7 errata-xmlrpc 2020-07-13 17:43:40 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:2409