Verified on 4.7.0-0.nightly-2021-03-26-105314 $ oc get nodes NAME STATUS ROLES AGE VERSION ip-10-0-130-216.us-west-2.compute.internal Ready master 57m v1.20.0+bafe72f ip-10-0-140-126.us-west-2.compute.internal Ready worker 44m v1.20.0+bafe72f ip-10-0-160-193.us-west-2.compute.internal Ready worker 45m v1.20.0+bafe72f ip-10-0-169-235.us-west-2.compute.internal Ready master 56m v1.20.0+bafe72f ip-10-0-194-63.us-west-2.compute.internal Ready master 55m v1.20.0+bafe72f ip-10-0-212-179.us-west-2.compute.internal Ready worker 44m v1.20.0+bafe72f $ oc get pods -A --field-selector spec.nodeName=ip-10-0-140-126.us-west-2.compute.internal NAMESPACE NAME READY STATUS RESTARTS AGE openshift-cluster-csi-drivers aws-ebs-csi-driver-node-2h7dn 3/3 Running 0 44m openshift-cluster-node-tuning-operator tuned-7tk9h 1/1 Running 0 44m openshift-dns dns-default-pp7gc 3/3 Running 0 44m openshift-image-registry node-ca-kbj4q 1/1 Running 0 44m openshift-ingress-canary ingress-canary-l7ljl 1/1 Running 0 43m openshift-machine-config-operator machine-config-daemon-qvhbh 2/2 Running 0 44m openshift-marketplace redhat-operators-xrdsn 0/1 Running 0 12s openshift-monitoring node-exporter-grttn 2/2 Running 0 44m openshift-monitoring prometheus-adapter-7c467b59b4-cs6kt 1/1 Running 0 42m openshift-multus multus-8xkrz 1/1 Running 0 44m openshift-multus network-metrics-daemon-zmzc8 2/2 Running 0 44m openshift-network-diagnostics network-check-target-lb6lv 1/1 Running 0 44m openshift-sdn ovs-cgbf6 1/1 Running 0 44m openshift-sdn sdn-h8jq5 2/2 Running 0 44m $ oc -n openshift-machine-config-operator logs machine-config-daemon-qvhbh -c machine-config-daemon I0326 15:28:46.919115 1956 start.go:108] Version: v4.7.0-202103242217.p0-dirty (558c30a44597932780de585a1b888b2848f45fe3) I0326 15:28:47.028844 1956 start.go:121] Calling chroot("/rootfs") I0326 15:28:47.029162 1956 rpm-ostree.go:261] Running captured: rpm-ostree status --json I0326 15:28:47.425368 1956 daemon.go:218] Booted osImageURL: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0ad297b22e7b96e04e45aefcc57f571361c87bdc3110e692bb239f2dfbe64050 (47.83.202103251640-0) I0326 15:28:47.579924 1956 start.go:97] Copied self to /run/bin/machine-config-daemon on host I0326 15:28:47.581819 1956 metrics.go:105] Registering Prometheus metrics I0326 15:28:47.582840 1956 metrics.go:110] Starting metrics listener on 127.0.0.1:8797 I0326 15:28:47.586312 1956 update.go:1904] Starting to manage node: ip-10-0-140-126.us-west-2.compute.internal I0326 15:28:47.591910 1956 rpm-ostree.go:261] Running captured: rpm-ostree status I0326 15:28:47.636650 1956 daemon.go:849] State: idle Deployments: * pivot://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0ad297b22e7b96e04e45aefcc57f571361c87bdc3110e692bb239f2dfbe64050 CustomOrigin: Managed by machine-config-operator Version: 47.83.202103251640-0 (2021-03-25T16:44:03Z) ostree://3fdd1488024f054e39b1be508781d535d1ac7ed423bb3b4b656c2f345934220d Version: 47.83.202103251640-0 (2021-03-25T16:44:03Z) I0326 15:28:47.636887 1956 rpm-ostree.go:261] Running captured: journalctl --list-boots I0326 15:28:47.641426 1956 daemon.go:856] journalctl --list-boots: -1 1020936e189a4fdfa423d620917deead Fri 2021-03-26 15:21:37 UTC—Fri 2021-03-26 15:27:59 UTC 0 86930a65b97846b2af5cb336ab29e128 Fri 2021-03-26 15:28:14 UTC—Fri 2021-03-26 15:28:47 UTC I0326 15:28:47.641443 1956 rpm-ostree.go:261] Running captured: systemctl list-units --state=failed --no-legend I0326 15:28:47.647763 1956 daemon.go:871] systemd service state: OK I0326 15:28:47.647777 1956 daemon.go:603] Starting MachineConfigDaemon I0326 15:28:47.647855 1956 daemon.go:610] Enabling Kubelet Healthz Monitor I0326 15:29:17.588782 1956 trace.go:205] Trace[646203300]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:134 (26-Mar-2021 15:28:47.587) (total time: 30001ms): Trace[646203300]: [30.001424957s] [30.001424957s] END E0326 15:29:17.588807 1956 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://172.30.0.1:443/api/v1/nodes?limit=500&resourceVersion=0": dial tcp 172.30.0.1:443: i/o timeout I0326 15:29:17.588899 1956 trace.go:205] Trace[1747278511]: "Reflector ListAndWatch" name:github.com/openshift/machine-config-operator/pkg/generated/informers/externalversions/factory.go:101 (26-Mar-2021 15:28:47.587) (total time: 30001ms): Trace[1747278511]: [30.001035768s] [30.001035768s] END E0326 15:29:17.588907 1956 reflector.go:138] github.com/openshift/machine-config-operator/pkg/generated/informers/externalversions/factory.go:101: Failed to watch *v1.MachineConfig: failed to list *v1.MachineConfig: Get "https://172.30.0.1:443/apis/machineconfiguration.openshift.io/v1/machineconfigs?limit=500&resourceVersion=0": dial tcp 172.30.0.1:443: i/o timeout I0326 15:29:19.809661 1956 daemon.go:387] Node ip-10-0-140-126.us-west-2.compute.internal is not labeled node-role.kubernetes.io/master I0326 15:29:19.809787 1956 node.go:24] No machineconfiguration.openshift.io/currentConfig annotation on node ip-10-0-140-126.us-west-2.compute.internal: map[csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-06d5231a52fa78957"} machine.openshift.io/machine:openshift-machine-api/mnguyen47bootimage-cmmk5-worker-us-west-2a-gcgbl volumes.kubernetes.io/controller-managed-attach-detach:true], in cluster bootstrap, loading initial node annotation from /etc/machine-config-daemon/node-annotations.json I0326 15:29:19.813597 1956 node.go:45] Setting initial node config: rendered-worker-de61321df8ce70d43d4ee2842b2cf853 I0326 15:29:19.835633 1956 daemon.go:767] In bootstrap mode I0326 15:29:19.835651 1956 daemon.go:795] Current+desired config: rendered-worker-de61321df8ce70d43d4ee2842b2cf853 I0326 15:29:19.843224 1956 daemon.go:1047] No bootstrap pivot required; unlinking bootstrap node annotations I0326 15:29:19.843263 1956 daemon.go:1085] Validating against pending config rendered-worker-de61321df8ce70d43d4ee2842b2cf853 I0326 15:29:19.885584 1956 daemon.go:1096] Validated on-disk state I0326 15:29:19.916493 1956 daemon.go:1151] Completing pending config rendered-worker-de61321df8ce70d43d4ee2842b2cf853 I0326 15:29:19.916510 1956 update.go:1904] completed update for config rendered-worker-de61321df8ce70d43d4ee2842b2cf853 I0326 15:29:19.919878 1956 daemon.go:1167] In desired config rendered-worker-de61321df8ce70d43d4ee2842b2cf853 $ oc -n openshift-machine-config-operator logs machine-config-daemon-qvhbh -c machine-config-daemon | grep -i "installed ignition" $ oc get clusterversion NAME VERSION AVAILABLE PROGRESSING SINCE STATUS version 4.7.0-0.nightly-2021-03-26-105314 True False 32m Cluster version is 4.7.0-0.nightly-2021-03-26-105314
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (Moderate: OpenShift Container Platform 4.7.5 security and bug fix update), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHSA-2021:1005