Bug 1373288 - [Monitoring] Disk Availability Tracking in Metrics
Summary: [Monitoring] Disk Availability Tracking in Metrics
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: RFE
Version: 3.2.0
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: ---
: 3.11.z
Assignee: Paul Weil
QA Contact: Xiaoli Tian
URL:
Whiteboard:
: 1548249 (view as bug list)
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2016-09-05 19:03 UTC by Steven Walter
Modified: 2023-10-06 17:33 UTC (History)
32 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2019-05-15 16:04:49 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)
Disk Utilisation Usage data (73.65 KB, image/png)
2019-02-25 09:32 UTC, Junqi Zhao
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Red Hat Knowledge Base (Solution) 3020851 0 None None None 2018-02-23 02:44:10 UTC

Description Steven Walter 2016-09-05 19:03:55 UTC
1. Proposed title of this feature request
Disk Availability Tracking in Metrics

3. What is the nature and description of the request?
Customer would like a way to track disk usage in the metrics. Customer is prioritizing ephemeral disk usage of docker pods, but would also find persistent volume tracking to be useful.

4. Why does the customer need this? (List the business requirements here)
It is important to be able to track disk usage to not run out, especially as running out of disk space can cause issues that require more than just throwing extra storage on. This is important for stability reasons and to ensure that there is no downtime.

5. How would the customer like to achieve this? (List the functional requirements here)
Add tracking of disk usage as well as graphs in the console as with mem and cpu

7. Is there already an existing RFE upstream or in Red Hat bugzilla?
No BZ, but there is https://trello.com/c/lBWEQiHr/269-3-r-d-gather-pv-disk-usage-metrics-heapster-epic-ois-met-ux

Comment 2 Matt Wringe 2016-09-06 19:32:03 UTC
Are you looking for just how much disk space is being used? eg using 10Gi of space out of 120Gi? Or are you looking for something like IOPS? Or something else?

Comment 3 Steven Walter 2016-11-21 14:09:01 UTC
It appears the customer is looking for information on how much disk space is currently being used by the container either via PV or ephemeral storage; they make no mention of IOPS or etc, and seem to be focused on current disk allocation.

Comment 5 Nicolas Nosenzo 2017-03-06 15:48:08 UTC
Hello, 
Do we have a target version/date for this?

Comment 6 Matt Wringe 2017-03-06 16:17:17 UTC
In 3.5:

We have a few metrics here with regards to filesystem. We can see the usage and limit for each pod and each volume in the pod (note: we don't have PV usage metrics yet)

We can also get the usage and limit values for the nodes themselves.

In 3.4:

There are some of preliminary filesystem metrics in here as well, but not to the extent that they are in 3.5


Note that none of these metrics are being displayed in the console anywhere and are only currently available via the Hawkular Metrics REST API. PRs have been opened for the console to start graphing this information.

Comment 7 Robson Watt 2017-03-28 12:14:13 UTC
(In reply to Matt Wringe from comment #6)
> In 3.5:
> 
> We have a few metrics here with regards to filesystem. We can see the usage
> and limit for each pod and each volume in the pod (note: we don't have PV
> usage metrics yet)
> 
> We can also get the usage and limit values for the nodes themselves.
> 
> In 3.4:
> 
> There are some of preliminary filesystem metrics in here as well, but not to
> the extent that they are in 3.5
> 
> 
> Note that none of these metrics are being displayed in the console anywhere
> and are only currently available via the Hawkular Metrics REST API. PRs have
> been opened for the console to start graphing this information.

Hi Matt, 

  Could customer review this metrics now? Do we have a documentation to explain that step by step?

Thanks!

Robson

Comment 17 Javier Ramirez 2018-01-01 15:10:13 UTC
Any update?

Comment 19 Bryan Yount 2018-02-23 02:42:13 UTC
*** Bug 1548249 has been marked as a duplicate of this bug. ***

Comment 26 Paul Wright 2018-07-24 16:47:46 UTC
any update on this?

Comment 30 Weston Greene 2019-01-10 10:50:16 UTC
I'm also curious about an update for this.

Comment 38 Junqi Zhao 2019-02-21 11:09:56 UTC
It is better to set a Target Release, then would be easy to verify

Comment 39 Junqi Zhao 2019-02-25 09:32:45 UTC
Created attachment 1538368 [details]
Disk Utilisation Usage data

Comment 40 Junqi Zhao 2019-02-25 09:37:17 UTC
See the picture in Comment 39, we can show the Disk usage data in grafana, and could also check volume info from prometheus

kubelet_volume_stats_used_bytes -> used bytes, kubelet_volume_stats_available_bytes -> available bytes

There is one Bug 1680517 on openstack now, but works with aws/gce, it does not related to this RFE, set it to VERIFIED.

cluster monitoring images: v3.11.88


Note You need to log in before you can comment on or make changes to this bug.