Bug 1703727

Summary: etcd endpoints is not in kube-system namespace now
Product: OpenShift Container Platform Reporter: Junqi Zhao <juzhao>
Component: EtcdAssignee: Sam Batschelet <sbatsche>
Status: CLOSED CURRENTRELEASE QA Contact: ge liu <geliu>
Severity: medium Docs Contact:
Priority: unspecified    
Version: 4.1.0Keywords: CodeChange
Target Milestone: ---   
Target Release: 4.1.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2019-05-02 12:21:49 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
etcd targets number is 0 none

Description Junqi Zhao 2019-04-28 02:23:42 UTC
Created attachment 1559545 [details]
etcd targets number is 0

Description of problem:
etcd monitoring is enabled by default now, and etcd endpoints/pods are changed to openshift-etcd namespace, not kube-system now

$ oc get ep --all-namespaces | grep etcd
openshift-etcd                                          etcd                               10.0.141.200:9979,10.0.150.132:9979,10.0.171.77:9979 + 3 more...       75m
openshift-etcd                                          host-etcd                          192.0.2.1:2379,192.0.2.2:2379,192.0.2.3:2379                           76m

$ oc get po --all-namespaces | grep etcd
openshift-etcd                                          etcd-member-ip-10-0-141-200.us-east-2.compute.internal                2/2     Running     0          77m
openshift-etcd                                          etcd-member-ip-10-0-150-132.us-east-2.compute.internal                2/2     Running     0          76m
openshift-etcd                                          etcd-member-ip-10-0-171-77.us-east-2.compute.internal                 2/2     Running     0          76m
**************************************************
namespace is still kube-system in prometheus configuration file for etcd targets, should be changed accordingly, otherwise etcd targets can not be detected.
**************************************************
- job_name: openshift-monitoring/etcd/0
  scrape_interval: 30s
  scrape_timeout: 10s
  metrics_path: /metrics
  scheme: https
  kubernetes_sd_configs:
  - role: endpoints
    namespaces:
      names:
      - kube-system

Version-Release number of selected component (if applicable):
4.1.0-0.nightly-2019-04-25-121505

How reproducible:
Always

Steps to Reproduce:
1. Check prometheus /targets page
2.
3.

Actual results:
etcd targets can not be detected.

Expected results:
etcd targets could be detected.

Additional info: