Red Hat Bugzilla – Bug 1594862
Thresholds for utilization bars and alerts differ
Last modified: 2018-09-04 03:08:46 EDT
Created attachment 1454380 [details] Brick Details page Description of problem: There is a difference between thresholds set for brick utilization bars in UI and in Grafana for `Warning` alert. Version-Release number of selected component (if applicable): tendrl-ansible-1.6.3-5.el7rhgs.noarch tendrl-api-1.6.3-3.el7rhgs.noarch tendrl-api-httpd-1.6.3-3.el7rhgs.noarch tendrl-commons-1.6.3-7.el7rhgs.noarch tendrl-grafana-plugins-1.6.3-5.el7rhgs.noarch tendrl-grafana-selinux-1.5.4-2.el7rhgs.noarch tendrl-monitoring-integration-1.6.3-5.el7rhgs.noarch tendrl-node-agent-1.6.3-7.el7rhgs.noarch tendrl-notifier-1.6.3-4.el7rhgs.noarch tendrl-selinux-1.5.4-2.el7rhgs.noarch tendrl-ui-1.6.3-4.el7rhgs.noarch How reproducible: 100% Steps to Reproduce: 1. Import cluster with volume. 2. Fill volume above 75% of volume utilization. 3. Go to Volume and Brick Detail pages. 4. Check utilization of bricks and alerts. Actual results: * The utilization bar in UI remains blue until the brick is filled up to 80%. When utilization of brick/volume crosses 80% the utilization bar changes to orange. * Alerts (mail, snmp, alerts panel in UI) are generated when utilization breaches 75%. Expected results: Utilization thresholds for alerts should be unified. Additional info:
The storage machines are distributed systems, when you push the data from mount point rebalance will keep happening, So utilization for the brick some time increased and decrease based on rebalancing. So grafana will raise alert using current disk utilization but it will differ before it reaches tendrl services.
UI PR is merged. Since grafana implementation is not yet done, moving it to Assigned state to @anbehl@redhat.com
Utilization bars change colour to orange when utilization is above 75% which is the same amount used for generating alerts. --> VERIFIED Tested with: tendrl-ansible-1.6.3-5.el7rhgs.noarch tendrl-api-1.6.3-4.el7rhgs.noarch tendrl-api-httpd-1.6.3-4.el7rhgs.noarch tendrl-commons-1.6.3-9.el7rhgs.noarch tendrl-grafana-plugins-1.6.3-7.el7rhgs.noarch tendrl-grafana-selinux-1.5.4-2.el7rhgs.noarch tendrl-monitoring-integration-1.6.3-7.el7rhgs.noarch tendrl-node-agent-1.6.3-9.el7rhgs.noarch tendrl-notifier-1.6.3-4.el7rhgs.noarch tendrl-selinux-1.5.4-2.el7rhgs.noarch tendrl-ui-1.6.3-8.el7rhgs.noarch
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHSA-2018:2616