Bug 1846250 - etcd-operator does not remove bootstrap ip address post cluster bootstrap complete
Summary: etcd-operator does not remove bootstrap ip address post cluster bootstrap com...
Keywords:
Status: CLOSED DUPLICATE of bug 1835238
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Etcd Operator
Version: 4.4
Hardware: x86_64
OS: Linux
unspecified
medium
Target Milestone: ---
: ---
Assignee: Sam Batschelet
QA Contact: ge liu
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-06-11 08:34 UTC by Jatan Malde
Modified: 2023-10-06 20:34 UTC (History)
0 users

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2020-06-11 08:44:34 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)

Description Jatan Malde 2020-06-11 08:34:37 UTC
Description of problem:

Hello Team,

For OCP 4.4.x installation, the etcd-operator does not remove the bootstrap-ip from the environment variable setup. While I list the member list I see the expected outputs but listing the etcdctl health reports 4 which includes bootstrap. 

The environment variable inside the etcd-member container lists 4 endpoint, 

[root@vm251-77 ~]# oc project openshift-etcd
Now using project "openshift-etcd" on server "https://api.jack4.testing.com:6443".
[root@vm251-77 ~]# oc get pods
NAME                                           READY   STATUS      RESTARTS   AGE
etcd-master-0.jack4.testing.com                3/3     Running     0          12d
etcd-master-1.jack4.testing.com                3/3     Running     0          12d
etcd-master-2.jack4.testing.com                3/3     Running     0          12d
revision-pruner-4-master-0.jack4.testing.com   0/1     Completed   0          9d
revision-pruner-4-master-1.jack4.testing.com   0/1     Completed   0          9d
revision-pruner-4-master-2.jack4.testing.com   0/1     Completed   0          9d

[root@vm251-77 ~]# oc rsh etcd-master-1.jack4.testing.com
sh-4.2# etcdctl member list
55a048fad1869255, started, master-0.jack4.testing.com, https://10.74.255.63:2380, https://10.74.255.63:2379
ce8cb7e5fa5bd00d, started, master-1.jack4.testing.com, https://10.74.255.132:2380, https://10.74.255.132:2379
e920672742b0547b, started, master-2.jack4.testing.com, https://10.74.255.48:2380, https://10.74.255.48:2379

sh-4.2# etcdctl endpoint health 
{"level":"warn","ts":"2020-06-11T08:23:55.230Z","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-76e59023-a774-4ee0-b8a3-606e0454d80b/10.74.253.113:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \"transport: Error while dialing dial tcp 10.74.253.113:2379: connect: connection refused\""}
https://10.74.255.48:2379 is healthy: successfully committed proposal: took = 43.986993ms
https://10.74.255.132:2379 is healthy: successfully committed proposal: took = 27.257936ms
https://10.74.255.63:2379 is healthy: successfully committed proposal: took = 29.238107ms
https://10.74.253.113:2379 is unhealthy: failed to commit proposal: context deadline exceeded
Error: unhealthy cluster
sh-4.2# env | grep -i endpoi
ALL_ETCD_ENDPOINTS=https://10.74.255.63:2379,https://10.74.255.132:2379,https://10.74.255.48:2379,https://10.74.253.113:2379
ETCDCTL_ENDPOINTS=https://10.74.255.63:2379,https://10.74.255.132:2379,https://10.74.255.48:2379,https://10.74.253.113:2379
sh-4.2# [root@vm251-77 ~]# 

Here 10.74.253..113 is the ip address of the bootstrap machine which out and the cluster is up and running fine. 

Version-Release number of selected component (if applicable):

[root@vm251-77 ~]# oc get clusterversion
NAME      VERSION   AVAILABLE   PROGRESSING   SINCE   STATUS
version   4.4.6     True        False         9d      Cluster version is 4.4.6

[root@vm251-77 ~]# 



How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:


Note You need to log in before you can comment on or make changes to this bug.