Bug 1704573
| Summary: | prometheus-k8s serviceaccount cannot list endpoints in the namespace openshift-etcd | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Product: | OpenShift Container Platform | Reporter: | Junqi Zhao <juzhao> | ||||||
| Component: | Monitoring | Assignee: | Frederic Branczyk <fbranczy> | ||||||
| Status: | CLOSED ERRATA | QA Contact: | Peter Ruan <pruan> | ||||||
| Severity: | high | Docs Contact: | |||||||
| Priority: | high | ||||||||
| Version: | unspecified | CC: | anpicker, erooth, mifiedle, mloibl, pkrupa, pruan, surbania | ||||||
| Target Milestone: | --- | Keywords: | Regression, TestBlocker | ||||||
| Target Release: | 4.1.0 | ||||||||
| Hardware: | Unspecified | ||||||||
| OS: | Unspecified | ||||||||
| Whiteboard: | |||||||||
| Fixed In Version: | Doc Type: | If docs needed, set a value | |||||||
| Doc Text: | Story Points: | --- | |||||||
| Clone Of: | Environment: | ||||||||
| Last Closed: | 2019-06-04 10:48:18 UTC | Type: | Bug | ||||||
| Regression: | --- | Mount Type: | --- | ||||||
| Documentation: | --- | CRM: | |||||||
| Verified Versions: | Category: | --- | |||||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||||
| Embargoed: | |||||||||
| Attachments: |
|
||||||||
blocks etcd monitoring testing Created attachment 1560176 [details]
prometheus-k8s sa info
PR merged. verified with I can see openshift-monitoring/etcd/0 in prometheus UI, and there's a etcd section under grafana verified with nightly build 4.1.0-0.nightly-2019-05-01-002148 Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2019:0758 |
Created attachment 1560175 [details] prometheus-k8s pod logs Description of problem: etcd pods/services are moved to openshift-etcd project now, but the etcd svc can not be discovered and can not show etcd data in grafana UI error in prometheus-k8s pod logs shows: level=error ts=2019-04-30T04:06:58.311Z caller=klog.go:94 component=k8s_client_runtime func=ErrorDepth msg="github.com/prometheus/prometheus/discovery/kubernetes/kubernetes.go:300: Failed to list *v1.Endpoints: endpoints is forbidden: User \"system:serviceaccount:openshift-monitoring:prometheus-k8s\" cannot list resource \"endpoints\" in API group \"\" in the namespace \"openshift-etcd\"" Version-Release number of selected component (if applicable): 4.1.0-0.nightly-2019-04-28-064010 How reproducible: Always Steps to Reproduce: 1. Check etcd targets in prometheus /service-discovery page 2. 3. Actual results: etcd svc can not be discovered Expected results: etcd svc should be discovered Additional info: