Bug 1480051 - [starter][starter-us-east-1]Metrics route is not accessible
Summary: [starter][starter-us-east-1]Metrics route is not accessible
Keywords:
Status: CLOSED NOTABUG
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Hawkular
Version: unspecified
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: ---
: ---
Assignee: Matt Wringe
QA Contact: Junqi Zhao
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2017-08-10 02:14 UTC by Junqi Zhao
Modified: 2018-07-26 19:08 UTC (History)
1 user (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2017-08-10 13:36:58 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)
"Application is not available" error for metrics route (73.33 KB, image/png)
2017-08-10 02:14 UTC, Junqi Zhao
no flags Details

Description Junqi Zhao 2017-08-10 02:14:11 UTC
Created attachment 1311512 [details]
"Application is not available" error for metrics route

Description of problem:
starter-us-east-1 env, Metrics route is not accessible."Application is not available" when accesssing metrics route

Command ***** oc get pod -n openshift-infra ***** result as below, hawkular-metrics pod is not reday:

NAME                         READY     STATUS              RESTARTS   AGE
hawkular-cassandra-1-csx0z   1/1       Running             0          1h
hawkular-cassandra-2-rxtzx   0/1       ContainerCreating   0          1h
hawkular-metrics-1kgwg       0/1       Running             9          1h
heapster-z0f0h               0/1       Running             50         7h


Version-Release number of selected component (if applicable):

OpenShift Master:v3.6.173.0.5 (online version 3.5.0.20)
Kubernetes Master:v1.6.1+5115d708d7 

How reproducible:
Always

Steps to Reproduce:
1. login https://metrics.starter-us-east-1.openshift.com/hawkular/metrics
2. 
3.

Actual results:
Application is not available shows in UI. 


Expected results:
Metrics route could be accessed

Additional info:

Comment 1 Matt Wringe 2017-08-10 13:36:58 UTC
The route is not available because the Hawkular Metrics service doesn't have any running pods currently.

This is always the expected behaviour with the router when there are no running pods behind it, it should be clearly stated in the error message from the router when this happens.

The problem here is most likely because the Cassandra pod is stuck in the 'ContainerCreating' phase. Someone needs to fix that problem first (which is not related to metrics, this is likely caused by something like the PV that Cassandra needs cannot be mounted, or there isn't enough room on the node to deploy the pod)

Comment 2 Junqi Zhao 2017-08-11 01:49:42 UTC
Metrics route could be accessed now.


Note You need to log in before you can comment on or make changes to this bug.