Bug 1988992
| Summary: | Worker machine object updated too many times [Azure] | ||
|---|---|---|---|
| Product: | OpenShift Container Platform | Reporter: | Jan Chaloupka <jchaloup> |
| Component: | Cloud Compute | Assignee: | Mike Fedosin <mfedosin> |
| Cloud Compute sub component: | Other Providers | QA Contact: | sunzhaohua <zhsun> |
| Status: | CLOSED ERRATA | Docs Contact: | |
| Severity: | medium | ||
| Priority: | medium | CC: | lakshmi.ravichandran1, mfedosin, suryadav |
| Version: | 4.9 | Keywords: | Reopened |
| Target Milestone: | --- | ||
| Target Release: | 4.9.0 | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | If docs needed, set a value | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2021-10-29 12:26:40 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
|
Description
Jan Chaloupka
2021-08-02 08:50:13 UTC
Verified
clusterversion: 4.9.0-0.nightly-2021-08-07-175228
$ oc logs machine-api-controllers-86cbb699b6-cqqs7 -c machine-controller | grep "Updated machine"
$
After delete a machine, logs show "Updated machine"
$ oc delete machine zhsun-811-px5nm-worker-centralus1-jwdww
machine.machine.openshift.io "zhsun-811-px5nm-worker-centralus1-jwdww" deleted
$ oc logs machine-api-controllers-86cbb699b6-cqqs7 -c machine-controller | grep "Updated machine"
I0811 06:35:41.473296 1 recorder.go:104] controller-runtime/manager/events "msg"="Normal" "message"="Updated machine \"zhsun-811-px5nm-worker-centralus1-6wc42\"" "object"={"kind":"Machine","namespace":"openshift-machine-api","name":"zhsun-811-px5nm-worker-centralus1-6wc42","uid":"336d9822-243d-48b6-9453-c8f1525478b6","apiVersion":"machine.openshift.io/v1beta1","resourceVersion":"98150"} "reason"="Updated"
I0811 06:36:42.145008 1 recorder.go:104] controller-runtime/manager/events "msg"="Normal" "message"="Updated machine \"zhsun-811-px5nm-worker-centralus1-6wc42\"" "object"={"kind":"Machine","namespace":"openshift-machine-api","name":"zhsun-811-px5nm-worker-centralus1-6wc42","uid":"336d9822-243d-48b6-9453-c8f1525478b6","apiVersion":"machine.openshift.io/v1beta1","resourceVersion":"98280"} "reason"="Updated"
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (Moderate: OpenShift Container Platform 4.9.0 bug fix and security update), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHSA-2021:3759 We can see similar failure with recent CI upgrade runs of OCP 4.9 to 4.10 and 4.8 to 4.9 for s390x. : [sig-arch] events should not repeat pathologically expand_less 0s 2 events happened too frequently event happened 34 times, something is wrong: ns/openshift-machine-api machine/libvirt-s390x-0-0-708-wltbm-worker-0-ck7tg - reason/Updated Updated Machine libvirt-s390x-0-0-708-wltbm-worker-0-ck7tg event happened 34 times, something is wrong: ns/openshift-machine-api machine/libvirt-s390x-0-0-708-wltbm-worker-0-trzd6 - reason/Updated Updated Machine libvirt-s390x-0-0-708-wltbm-worker-0-trzd6 1) 4.9 to 4.10 upgrade --> https://prow.ci.openshift.org/view/gs/origin-ci-test/logs/periodic-ci-openshift-multiarch-master-nightly-4.10-upgrade-from-nightly-4.9-ocp-remote-libvirt-s390x/1452575786342027264 2) 4.8 to 4.9 upgrade --> https://prow.ci.openshift.org/view/gs/origin-ci-test/logs/periodic-ci-openshift-multiarch-master-nightly-4.9-upgrade-from-nightly-4.8-ocp-remote-libvirt-s390x/1452288892060307456 Search results --> https://search.ci.openshift.org/?search=reason%2FUpdated+Updated+Machine&maxAge=48h&context=1&type=bug%2Bjunit&name=s390x&excludeName=&maxMatches=5&maxBytes=20971520&groupBy=job Folks, I think the issue you see is not related to Azure platform. The bug for Azure has been fixed in cluster-api-provider-azure in 4.9 by this commit: https://github.com/openshift/cluster-api-provider-azure/pull/227 Since you see a similar issue for libvirt, I recommend to create another bz and specify Libvirt platform in the description, so it can be fixed in https://github.com/openshift/cluster-api-provider-libvirt |