Bug 1644544

Summary: [3.9] Should remove router endpoints targets from kubernetes-service-endpoints
Product: OpenShift Container Platform Reporter: Junqi Zhao <juzhao>
Component: MonitoringAssignee: Paul Gier <pgier>
Status: CLOSED ERRATA QA Contact: Junqi Zhao <juzhao>
Severity: medium Docs Contact:
Priority: medium    
Version: 3.9.0CC: minden, spasquie, vrutkovs
Target Milestone: ---   
Target Release: 3.9.z   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Cause: Prometheus was automatically discovering two separate scrape endpoints for the kubernetes router. Consequence: One of the endpoints was not able to be scraped due to missing auth config. This appeared as a failing scrape in the prometheus status. Fix: Removed duplicate prometheus scrape endpoint for kubernetes router. Result: Prometheus only scrapes a single, working endpoint for the kubernetes router.
 Story Points: ---
Clone Of:
: 1644546 (view as bug list) Environment:
Last Closed: 2018-12-13 19:27:16 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1644546    
Attachments:
Description Flags
router endpoints are shown both under kubernetes-service-endpoints and openshift-router
none
prometheus configuration file
none
prometheus configuration 39 file
none
prometheus configuration 311 file for referrence
none
router endpoints targets are removed from kubernetes-service-endpoints target none

Description Junqi Zhao 2018-10-31 06:00:58 UTC 
Created attachment 1499214 [details]
router endpoints are shown both under kubernetes-service-endpoints and openshift-router

Should remove router endpoints targets from kubernetes-service-endpoints
Description of problem:
See the attached picture, router endpoints(http://172.18.0.17:1936/metrics, http://172.18.13.146:1936/metrics) are shown both under kubernetes-service-endpoints and openshift-router, router endpoints should only be shown under openshift-router

Version-Release number of selected component (if applicable):
prometheus v3.9.49-1

How reproducible:
Always

Steps to Reproduce:
1. Deploy prometheus v3.9.49-1 and check /targets page
2.
3.

Actual results:
router endpoints are shown both under kubernetes-service-endpoints and openshift-router

Expected results:
router endpoints should only be shown under openshift-router

Additional info:
Comment 1 Junqi Zhao 2018-10-31 06:02:39 UTC 
Created attachment 1499215 [details]
prometheus configuration file
Comment 2 Junqi Zhao 2018-10-31 06:07:52 UTC 
Created attachment 1499216 [details]
prometheus configuration 39 file
Comment 3 Junqi Zhao 2018-10-31 06:08:36 UTC 
Created attachment 1499217 [details]
prometheus configuration 311 file for referrence
Comment 4 Paul Gier 2018-11-06 19:58:35 UTC 
https://github.com/openshift/openshift-ansible/pull/10615
Comment 5 Vadim Rutkovsky 2018-11-12 11:40:39 UTC 
Fix is available in openshift-ansible-3.9.51-1
Comment 6 Junqi Zhao 2018-11-13 02:17:23 UTC 
Issue is fixed in openshift-ansible-3.9.51-1, router endpoints targets are removed from kubernetes-service-endpoints target
Comment 7 Junqi Zhao 2018-11-13 02:17:57 UTC 
Created attachment 1505048 [details]
router endpoints targets are removed from kubernetes-service-endpoints target
Comment 10 errata-xmlrpc 2018-12-13 19:27:16 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2018:3748