Bug 1538248 - [RFE] Performance Improvements
Summary: [RFE] Performance Improvements
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Gluster Storage
Classification: Red Hat Storage
Component: web-admin-tendrl-node-agent
Version: rhgs-3.3
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
: RHGS 3.4.0
Assignee: Jeff Brown
QA Contact: Daniel Horák
URL:
Whiteboard:
Depends On:
Blocks: 1503132
TreeView+ depends on / blocked
 
Reported: 2018-01-24 17:21 UTC by Nishanth Thomas
Modified: 2023-09-14 04:15 UTC (History)
8 users (show)

Fixed In Version: tendrl-commons-1.6.1-2.el7rhgs tendrl-node-agent-1.6.1-2.el7rhgs tendrl-api-1.6.1-2.el7rhgs tendrl-gluster-integration-1.6.1-2.el7rhgs tendrl-ui-1.6.1-2.el7rhgs tendrl-monitoring-integration-1.6.1-2.el7rhgs
Doc Type: Enhancement
Doc Text:
Cause: RHGSWA objects are not serialized and consume too much resources Consequence: RHGS-WA is consumes more than expected resources. Fix: Serialize/Deserialize tendrl objects, caching at tendrl-api Result: Faster API calls like ImportCluster, ExpandCluster, less resource consumption by RHGS WA services
Clone Of:
Environment:
Last Closed: 2018-09-04 07:00:53 UTC
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Bugzilla 1559432 0 unspecified CLOSED Before import cluster monitoring integration consumes lot of CPU and memory 2021-02-22 00:41:40 UTC
Red Hat Bugzilla 1561392 0 unspecified CLOSED RHGSWA generates a large amount of gluster logs 2021-02-22 00:41:40 UTC
Red Hat Bugzilla 1561468 0 unspecified CLOSED tendrl-node-agent CPU consumption 2021-02-22 00:41:40 UTC
Red Hat Bugzilla 1563648 0 unspecified CLOSED Marshal / Un-marshal objects while saving / reading to / from etcd 2021-02-22 00:41:40 UTC
Red Hat Bugzilla 1566023 0 unspecified CLOSED growing glusterd memory usage 2021-02-22 00:41:40 UTC
Red Hat Bugzilla 1583283 1 None None None 2024-09-18 00:47:58 UTC
Red Hat Bugzilla 1584593 0 unspecified CLOSED Import of 3 Node (100 Vols & 300 bricks) fails with Time-Out Error 2021-02-22 00:41:40 UTC
Red Hat Bugzilla 1596862 0 unspecified CLOSED Improve performance of tendrl components 2021-02-22 00:41:40 UTC
Red Hat Bugzilla 1599987 0 unspecified CLOSED Growing memory utilization of tendrl-gluster-integration on one node in cluster 2021-02-22 00:41:40 UTC
Red Hat Product Errata RHSA-2018:2616 0 None None None 2018-09-04 07:02:03 UTC


Description Nishanth Thomas 2018-01-24 17:21:34 UTC 
Description of problem:

Based on the current recommendation, WA requires a beefy node(12 vcpus and 32 GB of RAM) to monitor a storage pool of all sizes.

Expected results:
This should be optimized and required changes to be done to improve the performance(memory and CPU).

Additional info:
provide guidance regarding the system requirements scaling depending upon the gluster deployment configuration, short term. However, long term, we need to do more granular testing to figure out the exact performance requirements
separately for etcd and graphite+grafana.
Comment 6 Daniel Horák 2018-08-22 13:29:52 UTC 
Based on RHGSWA 3.4 Resource Consumption Analysis done by performance team
(with comparison to RHGSWA 3.3.1 Resource Consumption Analysis) there were,
performance improvements done for the RHGS WA services.

Minimal hardware requirements (mainly RAM size) are significantly lower (see
Bug 1570564 comment 17).

Also our (RHGS Console QE team) observation is, that the resource (memory and
CPU) consumption of each RHGS WA component is significantly lower and number
of performance issues for particular components were fixed.
E.g.: Bug 1561468, bug 1559432, bug 1599987, bug 1571235.

Performance team testing was done on following versions of selected components:
  RHGS WA Server:
  tendrl-selinux-1.5.4-2.el7rhgs.noarch
  tendrl-api-1.6.3-3.el7rhgs.noarch
  tendrl-monitoring-integration-1.6.3-2.el7rhgs.noarch
  tendrl-node-agent-1.6.3-4.el7rhgs.noarch
  tendrl-api-httpd-1.6.3-3.el7rhgs.noarch
  tendrl-grafana-plugins-1.6.3-2.el7rhgs.noarch
  tendrl-notifier-1.6.3-2.el7rhgs.noarch
  tendrl-ansible-1.6.3-2.el7rhgs.noarch
  tendrl-commons-1.6.3-4.el7rhgs.noarch
  tendrl-ui-1.6.3-1.el7rhgs.noarch
  tendrl-grafana-selinux-1.5.4-2.el7rhgs.noarch

  Gluster Storage Server:
  tendrl-collectd-selinux-1.5.4-2.el7rhgs.noarch
  tendrl-node-agent-1.6.3-4.el7rhgs.noarch
  tendrl-commons-1.6.3-4.el7rhgs.noarch
  tendrl-gluster-integration-1.6.3-2.el7rhgs.noarch
  tendrl-selinux-1.5.4-2.el7rhgs.noarch
  glusterfs-client-xlators-3.12.2-7.el7rhgs.x86_64
  glusterfs-cli-3.12.2-7.el7rhgs.x86_64
  glusterfs-fuse-3.12.2-7.el7rhgs.x86_64
  glusterfs-server-3.12.2-7.el7rhgs.x86_64
  glusterfs-libs-3.12.2-7.el7rhgs.x86_64
  glusterfs-3.12.2-7.el7rhgs.x86_64
  glusterfs-api-3.12.2-7.el7rhgs.x86_64
  python2-gluster-3.12.2-7.el7rhgs.x86_64
  glusterfs-events-3.12.2-7.el7rhgs.x86_64

Our (RHGS Console QE) last testing was done on:
  RHGS WA Server:
  Red Hat Enterprise Linux Server release 7.5 (Maipo)
  carbon-selinux-1.5.4-2.el7rhgs.noarch
  collectd-5.7.2-3.1.el7rhgs.x86_64
  collectd-ping-5.7.2-3.1.el7rhgs.x86_64
  etcd-3.2.7-1.el7.x86_64
  grafana-4.3.2-3.el7rhgs.x86_64
  libcollectdclient-5.7.2-3.1.el7rhgs.x86_64
  python-carbon-0.9.15-2.1.el7rhgs.noarch
  python-etcd-0.4.5-2.el7rhgs.noarch
  rubygem-etcd-0.3.0-2.el7rhgs.noarch
  tendrl-ansible-1.6.3-7.el7rhgs.noarch
  tendrl-api-1.6.3-5.el7rhgs.noarch
  tendrl-api-httpd-1.6.3-5.el7rhgs.noarch
  tendrl-commons-1.6.3-12.el7rhgs.noarch
  tendrl-grafana-plugins-1.6.3-10.el7rhgs.noarch
  tendrl-grafana-selinux-1.5.4-2.el7rhgs.noarch
  tendrl-monitoring-integration-1.6.3-10.el7rhgs.noarch
  tendrl-node-agent-1.6.3-10.el7rhgs.noarch
  tendrl-notifier-1.6.3-4.el7rhgs.noarch
  tendrl-selinux-1.5.4-2.el7rhgs.noarch
  tendrl-ui-1.6.3-11.el7rhgs.noarch

  Gluster Storage Server:
  Red Hat Enterprise Linux Server release 7.5 (Maipo)
  Red Hat Gluster Storage Server 3.4.0
  collectd-5.7.2-3.1.el7rhgs.x86_64
  collectd-ping-5.7.2-3.1.el7rhgs.x86_64
  glusterfs-3.12.2-16.el7rhgs.x86_64
  glusterfs-api-3.12.2-16.el7rhgs.x86_64
  glusterfs-cli-3.12.2-16.el7rhgs.x86_64
  glusterfs-client-xlators-3.12.2-16.el7rhgs.x86_64
  glusterfs-events-3.12.2-16.el7rhgs.x86_64
  glusterfs-fuse-3.12.2-16.el7rhgs.x86_64
  glusterfs-geo-replication-3.12.2-16.el7rhgs.x86_64
  glusterfs-libs-3.12.2-16.el7rhgs.x86_64
  glusterfs-rdma-3.12.2-16.el7rhgs.x86_64
  glusterfs-server-3.12.2-16.el7rhgs.x86_64
  gluster-nagios-addons-0.2.10-2.el7rhgs.x86_64
  gluster-nagios-common-0.2.4-1.el7rhgs.noarch
  libcollectdclient-5.7.2-3.1.el7rhgs.x86_64
  libvirt-daemon-driver-storage-gluster-3.9.0-14.el7_5.7.x86_64
  python2-gluster-3.12.2-16.el7rhgs.x86_64
  python-etcd-0.4.5-2.el7rhgs.noarch
  tendrl-collectd-selinux-1.5.4-2.el7rhgs.noarch
  tendrl-commons-1.6.3-12.el7rhgs.noarch
  tendrl-gluster-integration-1.6.3-10.el7rhgs.noarch
  tendrl-node-agent-1.6.3-10.el7rhgs.noarch
  tendrl-selinux-1.5.4-2.el7rhgs.noarch
  vdsm-gluster-4.19.43-2.3.el7rhgs.noarch

>> VERIFIED
Comment 14 errata-xmlrpc 2018-09-04 07:00:53 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2018:2616
Comment 15 Red Hat Bugzilla 2023-09-14 04:15:57 UTC 
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 1000 days
Note You need to log in before you can comment on or make changes to this bug.