Bug 2030353
| Summary: | patch pipeline--worker nodes unexpectedly reboot during scale out | ||
|---|---|---|---|
| Product: | OpenShift Container Platform | Reporter: | OpenShift BugZilla Robot <openshift-bugzilla-robot> |
| Component: | Node Tuning Operator | Assignee: | Jiří Mencák <jmencak> |
| Status: | CLOSED ERRATA | QA Contact: | liqcui |
| Severity: | high | Docs Contact: | |
| Priority: | high | ||
| Version: | 4.10 | CC: | aos-bugs, asoto, dagray, jerzhang, liqcui, mkrejci, ndabhi, tsedovic |
| Target Milestone: | --- | ||
| Target Release: | 4.8.z | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | If docs needed, set a value | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2022-01-05 16:11:42 UTC | Type: | --- |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
| Bug Depends On: | 2029693 | ||
| Bug Blocks: | 2024682 | ||
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (OpenShift Container Platform 4.8.25 bug fix update), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2021:5209 |
[ocpadmin@ec2-18-217-45-133 nto]$ cd cluster-node-tuning-operator/test/e2e/reboots [ocpadmin@ec2-18-217-45-133 reboots]$ oc get nodes NAME STATUS ROLES AGE VERSION ip-10-0-129-128.us-east-2.compute.internal Ready master 49m v1.21.6+c180a7c ip-10-0-147-93.us-east-2.compute.internal Ready worker 43m v1.21.6+c180a7c ip-10-0-163-12.us-east-2.compute.internal Ready worker 44m v1.21.6+c180a7c ip-10-0-168-99.us-east-2.compute.internal Ready master 49m v1.21.6+c180a7c ip-10-0-204-148.us-east-2.compute.internal Ready master 49m v1.21.6+c180a7c ip-10-0-217-134.us-east-2.compute.internal Ready worker 44m v1.21.6+c180a7c [ocpadmin@ec2-18-217-45-133 reboots]$ node1=ip-10-0-147-93.us-east-2.compute.internal [ocpadmin@ec2-18-217-45-133 reboots]$ node2=ip-10-0-163-12.us-east-2.compute.internal [ocpadmin@ec2-18-217-45-133 reboots]$ profileRealtime="../testing_manifests/stalld.yaml" [ocpadmin@ec2-18-217-45-133 reboots]$ mcpRealtime="../../../examples/realtime-mcp.yaml" [ocpadmin@ec2-18-217-45-133 reboots]$ nodeLabelRealtime="node-role.kubernetes.io/worker-rt" [ocpadmin@ec2-18-217-45-133 reboots]$ [ocpadmin@ec2-18-217-45-133 reboots]$ oc label no $node1 ${nodeLabelRealtime}= --overwrite node/ip-10-0-147-93.us-east-2.compute.internal labeled [ocpadmin@ec2-18-217-45-133 reboots]$ oc label no $node2 ${nodeLabelRealtime}= --overwrite node/ip-10-0-163-12.us-east-2.compute.internal labeled [ocpadmin@ec2-18-217-45-133 reboots]$ oc create -f $profileRealtime tuned.tuned.openshift.io/openshift-realtime created [ocpadmin@ec2-18-217-45-133 reboots]$ oc create -f $mcpRealtime machineconfigpool.machineconfiguration.openshift.io/worker-rt created [ocpadmin@ec2-18-217-45-133 reboots]$ oc get machineset -n openshift-machine-api NAME DESIRED CURRENT READY AVAILABLE AGE liqcui-oc484910-wd5jl-worker-us-east-2a 1 1 1 1 71m liqcui-oc484910-wd5jl-worker-us-east-2b 1 1 1 1 71m liqcui-oc484910-wd5jl-worker-us-east-2c 0 0 71m [ocpadmin@ec2-18-217-45-133 reboots]$ oc scale machineset/liqcui-oc484910-wd5jl-worker-us-east-2b --replicas=2 -n openshift-machine-api machineset.machine.openshift.io/liqcui-oc484910-wd5jl-worker-us-east-2b scaled [ocpadmin@ec2-18-217-45-133 reboots]$ oc scale machineset/liqcui-oc484910-wd5jl-worker-us-east-2c --replicas=1 -n openshift-machine-api machineset.machine.openshift.io/liqcui-oc484910-wd5jl-worker-us-east-2c scaled [ocpadmin@ec2-18-217-45-133 reboots]$ oc get clusterversion NAME VERSION AVAILABLE PROGRESSING SINCE STATUS version 4.8.0-0.nightly-2021-12-13-234359 True False 53m Cluster version is 4.8.0-0.nightly-2021-12-13-234359 Only new added labeled node rebooted, other old node don't reboot