Bug 1538248

Summary: [RFE] Performance Improvements
Product: [Red Hat Storage] Red Hat Gluster Storage Reporter: Nishanth Thomas <nthomas>
Component: web-admin-tendrl-node-agentAssignee: Jeff Brown <jefbrown>
Status: CLOSED ERRATA QA Contact: Daniel Horák <dahorak>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: rhgs-3.3CC: anbehl, dahorak, gshanmug, mbukatov, nthomas, rghatvis, rhs-bugs, shtripat
Target Milestone: ---Keywords: FutureFeature
Target Release: RHGS 3.4.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: tendrl-commons-1.6.1-2.el7rhgs tendrl-node-agent-1.6.1-2.el7rhgs tendrl-api-1.6.1-2.el7rhgs tendrl-gluster-integration-1.6.1-2.el7rhgs tendrl-ui-1.6.1-2.el7rhgs tendrl-monitoring-integration-1.6.1-2.el7rhgs Doc Type: Enhancement
Doc Text:
Cause: RHGSWA objects are not serialized and consume too much resources Consequence: RHGS-WA is consumes more than expected resources. Fix: Serialize/Deserialize tendrl objects, caching at tendrl-api Result: Faster API calls like ImportCluster, ExpandCluster, less resource consumption by RHGS WA services
 Story Points: ---
Clone Of: Environment:
Last Closed: 2018-09-04 07:00:53 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1503132    

Description Nishanth Thomas 2018-01-24 17:21:34 UTC 
Description of problem:

Based on the current recommendation, WA requires a beefy node(12 vcpus and 32 GB of RAM) to monitor a storage pool of all sizes.

Expected results:
This should be optimized and required changes to be done to improve the performance(memory and CPU).

Additional info:
provide guidance regarding the system requirements scaling depending upon the gluster deployment configuration, short term. However, long term, we need to do more granular testing to figure out the exact performance requirements
separately for etcd and graphite+grafana.
Comment 6 Daniel Horák 2018-08-22 13:29:52 UTC 
Based on RHGSWA 3.4 Resource Consumption Analysis done by performance team
(with comparison to RHGSWA 3.3.1 Resource Consumption Analysis) there were,
performance improvements done for the RHGS WA services.

Minimal hardware requirements (mainly RAM size) are significantly lower (see
Bug 1570564 comment 17).

Also our (RHGS Console QE team) observation is, that the resource (memory and
CPU) consumption of each RHGS WA component is significantly lower and number
of performance issues for particular components were fixed.
E.g.: Bug 1561468, bug 1559432, bug 1599987, bug 1571235.

Performance team testing was done on following versions of selected components:
  RHGS WA Server:
  tendrl-selinux-1.5.4-2.el7rhgs.noarch
  tendrl-api-1.6.3-3.el7rhgs.noarch
  tendrl-monitoring-integration-1.6.3-2.el7rhgs.noarch
  tendrl-node-agent-1.6.3-4.el7rhgs.noarch
  tendrl-api-httpd-1.6.3-3.el7rhgs.noarch
  tendrl-grafana-plugins-1.6.3-2.el7rhgs.noarch
  tendrl-notifier-1.6.3-2.el7rhgs.noarch
  tendrl-ansible-1.6.3-2.el7rhgs.noarch
  tendrl-commons-1.6.3-4.el7rhgs.noarch
  tendrl-ui-1.6.3-1.el7rhgs.noarch
  tendrl-grafana-selinux-1.5.4-2.el7rhgs.noarch

  Gluster Storage Server:
  tendrl-collectd-selinux-1.5.4-2.el7rhgs.noarch
  tendrl-node-agent-1.6.3-4.el7rhgs.noarch
  tendrl-commons-1.6.3-4.el7rhgs.noarch
  tendrl-gluster-integration-1.6.3-2.el7rhgs.noarch
  tendrl-selinux-1.5.4-2.el7rhgs.noarch
  glusterfs-client-xlators-3.12.2-7.el7rhgs.x86_64
  glusterfs-cli-3.12.2-7.el7rhgs.x86_64
  glusterfs-fuse-3.12.2-7.el7rhgs.x86_64
  glusterfs-server-3.12.2-7.el7rhgs.x86_64
  glusterfs-libs-3.12.2-7.el7rhgs.x86_64
  glusterfs-3.12.2-7.el7rhgs.x86_64
  glusterfs-api-3.12.2-7.el7rhgs.x86_64
  python2-gluster-3.12.2-7.el7rhgs.x86_64
  glusterfs-events-3.12.2-7.el7rhgs.x86_64

Our (RHGS Console QE) last testing was done on:
  RHGS WA Server:
  Red Hat Enterprise Linux Server release 7.5 (Maipo)
  carbon-selinux-1.5.4-2.el7rhgs.noarch
  collectd-5.7.2-3.1.el7rhgs.x86_64
  collectd-ping-5.7.2-3.1.el7rhgs.x86_64
  etcd-3.2.7-1.el7.x86_64
  grafana-4.3.2-3.el7rhgs.x86_64
  libcollectdclient-5.7.2-3.1.el7rhgs.x86_64
  python-carbon-0.9.15-2.1.el7rhgs.noarch
  python-etcd-0.4.5-2.el7rhgs.noarch
  rubygem-etcd-0.3.0-2.el7rhgs.noarch
  tendrl-ansible-1.6.3-7.el7rhgs.noarch
  tendrl-api-1.6.3-5.el7rhgs.noarch
  tendrl-api-httpd-1.6.3-5.el7rhgs.noarch
  tendrl-commons-1.6.3-12.el7rhgs.noarch
  tendrl-grafana-plugins-1.6.3-10.el7rhgs.noarch
  tendrl-grafana-selinux-1.5.4-2.el7rhgs.noarch
  tendrl-monitoring-integration-1.6.3-10.el7rhgs.noarch
  tendrl-node-agent-1.6.3-10.el7rhgs.noarch
  tendrl-notifier-1.6.3-4.el7rhgs.noarch
  tendrl-selinux-1.5.4-2.el7rhgs.noarch
  tendrl-ui-1.6.3-11.el7rhgs.noarch

  Gluster Storage Server:
  Red Hat Enterprise Linux Server release 7.5 (Maipo)
  Red Hat Gluster Storage Server 3.4.0
  collectd-5.7.2-3.1.el7rhgs.x86_64
  collectd-ping-5.7.2-3.1.el7rhgs.x86_64
  glusterfs-3.12.2-16.el7rhgs.x86_64
  glusterfs-api-3.12.2-16.el7rhgs.x86_64
  glusterfs-cli-3.12.2-16.el7rhgs.x86_64
  glusterfs-client-xlators-3.12.2-16.el7rhgs.x86_64
  glusterfs-events-3.12.2-16.el7rhgs.x86_64
  glusterfs-fuse-3.12.2-16.el7rhgs.x86_64
  glusterfs-geo-replication-3.12.2-16.el7rhgs.x86_64
  glusterfs-libs-3.12.2-16.el7rhgs.x86_64
  glusterfs-rdma-3.12.2-16.el7rhgs.x86_64
  glusterfs-server-3.12.2-16.el7rhgs.x86_64
  gluster-nagios-addons-0.2.10-2.el7rhgs.x86_64
  gluster-nagios-common-0.2.4-1.el7rhgs.noarch
  libcollectdclient-5.7.2-3.1.el7rhgs.x86_64
  libvirt-daemon-driver-storage-gluster-3.9.0-14.el7_5.7.x86_64
  python2-gluster-3.12.2-16.el7rhgs.x86_64
  python-etcd-0.4.5-2.el7rhgs.noarch
  tendrl-collectd-selinux-1.5.4-2.el7rhgs.noarch
  tendrl-commons-1.6.3-12.el7rhgs.noarch
  tendrl-gluster-integration-1.6.3-10.el7rhgs.noarch
  tendrl-node-agent-1.6.3-10.el7rhgs.noarch
  tendrl-selinux-1.5.4-2.el7rhgs.noarch
  vdsm-gluster-4.19.43-2.3.el7rhgs.noarch

>> VERIFIED
Comment 14 errata-xmlrpc 2018-09-04 07:00:53 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2018:2616
Comment 15 Red Hat Bugzilla 2023-09-14 04:15:57 UTC 
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 1000 days