Bug 1468969 - set the shard-block-size to 64MB in virt profile
Summary: set the shard-block-size to 64MB in virt profile
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Gluster Storage
Classification: Red Hat Storage
Component: sharding
Version: rhgs-3.3
Hardware: x86_64
OS: Unspecified
unspecified
urgent
Target Milestone: ---
: RHGS 3.3.1
Assignee: Krutika Dhananjay
QA Contact: SATHEESARAN
URL:
Whiteboard:
Depends On: 1489823 1492026
Blocks: Gluster-HC-3 1475688 1489352
TreeView+ depends on / blocked
 
Reported: 2017-07-10 06:39 UTC by SATHEESARAN
Modified: 2017-11-29 03:29 UTC (History)
10 users (show)

Fixed In Version: glusterfs-3.8.4-46
Doc Type: Bug Fix
Doc Text:
Previously, the default shard size was 4MB. This resulted in low I/O performance compared to larger shards for some common workloads. The default shard size has now been set to 64MB in order to address both self-heal and I/O performance needs.
Clone Of:
: 1489352 1489823 (view as bug list)
Environment:
Last Closed: 2017-11-29 03:29:14 UTC
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2017:3276 0 normal SHIPPED_LIVE glusterfs bug fix update 2017-11-29 08:28:52 UTC

Description SATHEESARAN 2017-07-10 06:39:24 UTC
Description of problem:
-----------------------
The better performance was observed with the shard-size of 128MB.
Virt profile should have this attribute and so its set on the volume when the volume is optimized for virt-profile

Version-Release number of selected component (if applicable):
-------------------------------------------------------------
RHGS 3.2.0

How reproducible:
-----------------
NA

Steps to Reproduce:
-------------------
NA

Actual results:
---------------
Shard-size is set to 4MB

Expected results:
-----------------
shard-size should be set to 128MB so that perf improvement is observed

Comment 1 SATHEESARAN 2017-07-10 06:52:40 UTC
At the moment, performance tests are done with different values and the value is yet to finalized based on the perf tests

Comment 6 SATHEESARAN 2017-09-08 09:23:33 UTC
Additiona info:

I have created a doc bug[1] to update the features.shard-block-size to 64MB with RHV-RHGS guide.

[1] - https://bugzilla.redhat.com/show_bug.cgi?id=1489743

Comment 7 Krutika Dhananjay 2017-09-08 12:39:23 UTC
https://review.gluster.org/#/c/18243/

Comment 8 Krutika Dhananjay 2017-09-14 08:26:55 UTC
https://code.engineering.redhat.com/gerrit/118074

Comment 9 Atin Mukherjee 2017-09-15 12:53:39 UTC
upstream mainline : https://review.gluster.org/#/c/18243/
upstream 3.12 : https://review.gluster.org/#/c/18305/
downstream : https://code.engineering.redhat.com/gerrit/118074

Comment 11 SATHEESARAN 2017-10-12 05:09:28 UTC
The original intent of the bug is to update the virt profile to have the shard-block-size as 64MB. But in actual, the default shard block size is now updated.


Tested with RHGS 3.3.1 interim build ( glusterfs-3.8.4-48.el7rhgs )
The default shard size is 64MB

[root@ ~]# gluster volume get test shard-block-size
Option                                  Value                                   
------                                  -----                                   
features.shard-block-size               64MB

Comment 15 Krutika Dhananjay 2017-11-14 16:29:14 UTC
Looks good to me, Pratik!

Comment 16 Pratik Mulay 2017-11-15 05:40:17 UTC
Changes in Doc Text to make it concise.

Comment 19 errata-xmlrpc 2017-11-29 03:29:14 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2017:3276


Note You need to log in before you can comment on or make changes to this bug.