Bug 1480051 - [starter][starter-us-east-1]Metrics route is not accessible
[starter][starter-us-east-1]Metrics route is not accessible
Product: OpenShift Online
Classification: Red Hat
Component: Metrics (Show other bugs)
Unspecified Unspecified
high Severity high
: ---
: ---
Assigned To: Matt Wringe
Junqi Zhao
Depends On:
  Show dependency treegraph
Reported: 2017-08-09 22:14 EDT by Junqi Zhao
Modified: 2017-08-10 21:49 EDT (History)
1 user (show)

See Also:
Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of:
Last Closed: 2017-08-10 09:36:58 EDT
Type: Bug
Regression: ---
Mount Type: ---
Documentation: ---
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---

Attachments (Terms of Use)
"Application is not available" error for metrics route (73.33 KB, image/png)
2017-08-09 22:14 EDT, Junqi Zhao
no flags Details

  None (edit)
Description Junqi Zhao 2017-08-09 22:14:11 EDT
Created attachment 1311512 [details]
"Application is not available" error for metrics route

Description of problem:
starter-us-east-1 env, Metrics route is not accessible."Application is not available" when accesssing metrics route

Command ***** oc get pod -n openshift-infra ***** result as below, hawkular-metrics pod is not reday:

NAME                         READY     STATUS              RESTARTS   AGE
hawkular-cassandra-1-csx0z   1/1       Running             0          1h
hawkular-cassandra-2-rxtzx   0/1       ContainerCreating   0          1h
hawkular-metrics-1kgwg       0/1       Running             9          1h
heapster-z0f0h               0/1       Running             50         7h

Version-Release number of selected component (if applicable):

OpenShift Master:v3. (online version
Kubernetes Master:v1.6.1+5115d708d7 

How reproducible:

Steps to Reproduce:
1. login https://metrics.starter-us-east-1.openshift.com/hawkular/metrics

Actual results:
Application is not available shows in UI. 

Expected results:
Metrics route could be accessed

Additional info:
Comment 1 Matt Wringe 2017-08-10 09:36:58 EDT
The route is not available because the Hawkular Metrics service doesn't have any running pods currently.

This is always the expected behaviour with the router when there are no running pods behind it, it should be clearly stated in the error message from the router when this happens.

The problem here is most likely because the Cassandra pod is stuck in the 'ContainerCreating' phase. Someone needs to fix that problem first (which is not related to metrics, this is likely caused by something like the PV that Cassandra needs cannot be mounted, or there isn't enough room on the node to deploy the pod)
Comment 2 Junqi Zhao 2017-08-10 21:49:42 EDT
Metrics route could be accessed now.

Note You need to log in before you can comment on or make changes to this bug.