Bug 2093819
| Summary: | An etcd member for a new machine was never added to the cluster | ||
|---|---|---|---|
| Product: | OpenShift Container Platform | Reporter: | Lukasz Szaszkiewicz <lszaszki> |
| Component: | Etcd | Assignee: | Thomas Jungblut <tjungblu> |
| Status: | CLOSED ERRATA | QA Contact: | ge liu <geliu> |
| Severity: | high | Docs Contact: | |
| Priority: | high | ||
| Version: | 4.11 | CC: | openshift-bugzilla-robot, skundu, tjungblu, wking |
| Target Milestone: | --- | ||
| Target Release: | 4.11.0 | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | non-multi-arch | ||
| Fixed In Version: | Doc Type: | If docs needed, set a value | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2022-08-10 11:16:18 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
| Bug Depends On: | |||
| Bug Blocks: | 2101460, 2101466 | ||
|
Description
Lukasz Szaszkiewicz
2022-06-06 07:24:21 UTC
I think I have found another run https://prow.ci.openshift.org/view/gs/origin-ci-test/logs/periodic-ci-openshift-release-master-nightly-4.11-e2e-aws-ovn-serial/1533646499815100416 (In reply to Lukasz Szaszkiewicz from comment #2) > and another one > https://prow.ci.openshift.org/view/gs/origin-ci-test/logs/periodic-ci- > openshift-multiarch-master-nightly-4.11-ocp-e2e-serial-aws-arm64/ > 1533937747629182976 sorry, wrong link, this one https://prow.ci.openshift.org/view/gs/origin-ci-test/logs/periodic-ci-openshift-release-master-nightly-4.11-e2e-aws-ovn-serial/1533646499815100416 *** Bug 2101460 has been marked as a duplicate of this bug. *** *** Bug 2101466 has been marked as a duplicate of this bug. *** oc get clusterversion NAME VERSION AVAILABLE PROGRESSING SINCE STATUS version 4.11.0-0.nightly-arm64-2022-06-30-005722 True False 71m Cluster version is 4.11.0-0.nightly-arm64-2022-06-30-005722 Initially started with 3 members. sh-4.4# etcdctl endpoint status -w table +---------------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+ | ENDPOINT | ID | VERSION | DB SIZE | IS LEADER | IS LEARNER | RAFT TERM | RAFT INDEX | RAFT APPLIED INDEX | ERRORS | +---------------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+ | https://10.0.144.66:2379 | bb508d87e68b6625 | 3.5.3 | 90 MB | false | false | 9 | 60469 | 60469 | | | https://10.0.187.63:2379 | 71ae3bc9b2cc9ed8 | 3.5.3 | 90 MB | false | false | 9 | 60523 | 60523 | | | https://10.0.214.219:2379 | 5ab798fcf577c78e | 3.5.3 | 91 MB | true | false | 9 | 60523 | 60523 | | +---------------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+ created new machine. oc create -f M0-new.yaml machine.machine.openshift.io/skundu-veri-11-ktp4k-master-new-0 created $ oc get machines NAME PHASE TYPE REGION ZONE AGE skundu-veri-11-ktp4k-master-0 Running c7g.2xlarge us-west-2 us-west-2a 73m skundu-veri-11-ktp4k-master-1 Running c7g.2xlarge us-west-2 us-west-2b 73m skundu-veri-11-ktp4k-master-2 Running c7g.2xlarge us-west-2 us-west-2c 73m skundu-veri-11-ktp4k-master-new-0 Provisioning c7g.2xlarge us-west-2 us-west-2a 18s skundu-veri-11-ktp4k-worker-us-west-2a-hvdnx Running c7g.xlarge us-west-2 us-west-2a 67m skundu-veri-11-ktp4k-worker-us-west-2b-xggqq Running c7g.xlarge us-west-2 us-west-2b 67m skundu-veri-11-ktp4k-worker-us-west-2c-vb42k Running c7g.xlarge us-west-2 us-west-2c 67m new machine gets in running phase. oc get machines NAME PHASE TYPE REGION ZONE AGE skundu-veri-11-ktp4k-master-0 Running c7g.2xlarge us-west-2 us-west-2a 81m skundu-veri-11-ktp4k-master-1 Running c7g.2xlarge us-west-2 us-west-2b 81m skundu-veri-11-ktp4k-master-2 Running c7g.2xlarge us-west-2 us-west-2c 81m skundu-veri-11-ktp4k-master-new-0 Running c7g.2xlarge us-west-2 us-west-2a 9m3s skundu-veri-11-ktp4k-worker-us-west-2a-hvdnx Running c7g.xlarge us-west-2 us-west-2a 76m skundu-veri-11-ktp4k-worker-us-west-2b-xggqq Running c7g.xlarge us-west-2 us-west-2b 76m skundu-veri-11-ktp4k-worker-us-west-2c-vb42k Running c7g.xlarge us-west-2 us-west-2c 76m oc get nodes NAME STATUS ROLES AGE VERSION ip-10-0-138-15.us-west-2.compute.internal Ready worker 71m v1.24.0+9ddc8b1 ip-10-0-144-66.us-west-2.compute.internal Ready master 81m v1.24.0+9ddc8b1 ip-10-0-153-143.us-west-2.compute.internal Ready master 2m56s v1.24.0+9ddc8b1 ip-10-0-183-56.us-west-2.compute.internal Ready worker 72m v1.24.0+9ddc8b1 ip-10-0-187-63.us-west-2.compute.internal Ready master 81m v1.24.0+9ddc8b1 ip-10-0-206-24.us-west-2.compute.internal Ready worker 67m v1.24.0+9ddc8b1 ip-10-0-214-219.us-west-2.compute.internal Ready master 81m v1.24.0+9ddc8b1 All four member endpoints are available. sh-4.4# etcdctl endpoint status -w table +---------------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+ | ENDPOINT | ID | VERSION | DB SIZE | IS LEADER | IS LEARNER | RAFT TERM | RAFT INDEX | RAFT APPLIED INDEX | ERRORS | +---------------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+ | https://10.0.144.66:2379 | bb508d87e68b6625 | 3.5.3 | 107 MB | false | false | 12 | 64988 | 64988 | | | https://10.0.153.143:2379 | 5d4549cd383fea08 | 3.5.3 | 104 MB | false | false | 12 | 64988 | 64988 | | | https://10.0.187.63:2379 | 71ae3bc9b2cc9ed8 | 3.5.3 | 106 MB | true | false | 12 | 64988 | 64988 | | | https://10.0.214.219:2379 | 5ab798fcf577c78e | 3.5.3 | 107 MB | false | false | 12 | 64988 | 64988 | | +---------------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+ *** Bug 2093827 has been marked as a duplicate of this bug. *** *** Bug 2090628 has been marked as a duplicate of this bug. *** Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (Important: OpenShift Container Platform 4.11.0 bug fix and security update), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHSA-2022:5069 |