Bug 1218475

Summary: [FEAT] - Sharding xlator
Product: [Community] GlusterFS Reporter: Krutika Dhananjay <kdhananj>
Component: shardingAssignee: Krutika Dhananjay <kdhananj>
Status: CLOSED CURRENTRELEASE QA Contact: bugs <bugs>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 3.7.0CC: bugs, gluster-bugs, sasundar
Target Milestone: ---Keywords: Triaged
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: glusterfs-3.7.0 Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: 1200082 Environment:
Last Closed: 2015-05-14 17:29:36 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1200082    
Bug Blocks: 1199352    

Description Krutika Dhananjay 2015-05-05 02:41:52 UTC
+++ This bug was initially created as a clone of Bug #1200082 +++

Description of problem:

This is a bug that is to be associated with the ongoing efforts w.r.t sharding translator.

https://gist.github.com/avati/af04f1030dcf52e16535#sharding-xlator-stripe-20

Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

--- Additional comment from Anand Avati on 2015-03-09 12:59:11 EDT ---

REVIEW: http://review.gluster.org/9841 (WIP: Sharding xlator) posted (#1) for review on master by Krutika Dhananjay (kdhananj)

--- Additional comment from Anand Avati on 2015-03-16 11:24:51 EDT ---

REVIEW: http://review.gluster.org/9841 (WIP: Sharding xlator) posted (#2) for review on master by Krutika Dhananjay (kdhananj)

--- Additional comment from Anand Avati on 2015-03-16 11:36:46 EDT ---

REVIEW: http://review.gluster.org/9841 (WIP: Sharding xlator) posted (#3) for review on master by Krutika Dhananjay (kdhananj)

--- Additional comment from Anand Avati on 2015-03-19 05:35:42 EDT ---

REVIEW: http://review.gluster.org/9841 (WIP: Sharding xlator) posted (#4) for review on master by Krutika Dhananjay (kdhananj)

--- Additional comment from Anand Avati on 2015-03-19 06:33:52 EDT ---

REVIEW: http://review.gluster.org/9841 (features/shard: Introducing sharding translator) posted (#5) for review on master by Krutika Dhananjay (kdhananj)

--- Additional comment from Anand Avati on 2015-03-19 07:43:26 EDT ---

REVIEW: http://review.gluster.org/9841 (features/shard: Introducing sharding translator) posted (#6) for review on master by Pranith Kumar Karampuri (pkarampu)

--- Additional comment from Anand Avati on 2015-03-19 13:59:35 EDT ---

COMMIT: http://review.gluster.org/9841 committed in master by Vijay Bellur (vbellur) 
------
commit 6f389fbb812b384bdd9bf4a20e86930505531996
Author: Krutika Dhananjay <kdhananj>
Date:   Fri Nov 21 11:47:23 2014 +0530

    features/shard: Introducing sharding translator
    
    Based on the high-level design by Anand V. Avati which can be found @
    https://gist.github.com/avati/af04f1030dcf52e16535#sharding-xlator-stripe-20
    
    Still to-do:
            * complete implementation of inode write fops - [f]truncate,
              zerofill, fallocate, discard
            * introduce transaction mechanism in inode write fops
            * complete readv
            * Handle open with O_TRUNC
            * Handle unlinking of all shards during unlink/rename
            * Compute total ia_size and ia_blocks in lookup, readdirp, etc
            * wind fsync/flush on all shards
    
            Note: Most of the items above are related. Once we come up
            with a clean way to determine the last shard/shard count for
            a file/file size and the mgmt of sparse regions of the file,
            implementing them becomes trivial.
    
    Change-Id: Id871379b53a4a916e4baa2e06f197dd8c0043b0f
    BUG: 1200082
    Signed-off-by: Krutika Dhananjay <kdhananj>
    Reviewed-on: http://review.gluster.org/9841
    Tested-by: Gluster Build System <jenkins.com>
    Reviewed-by: Vijay Bellur <vbellur>

--- Additional comment from Anand Avati on 2015-05-04 22:34:51 EDT ---

REVIEW: http://review.gluster.org/10537 (doc: Feature doc for shard translator) posted (#1) for review on master by Krutika Dhananjay (kdhananj)

Comment 1 Anand Avati 2015-05-05 02:45:15 UTC
REVIEW: http://review.gluster.org/10538 (doc: Feature doc for shard translator) posted (#1) for review on release-3.7 by Krutika Dhananjay (kdhananj)

Comment 2 Niels de Vos 2015-05-14 17:29:36 UTC
This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.7.0, please open a new bug report.

glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution.

[1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939
[2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user

Comment 3 Niels de Vos 2015-05-14 17:35:59 UTC
This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.7.0, please open a new bug report.

glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution.

[1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939
[2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user

Comment 4 Niels de Vos 2015-05-14 17:38:20 UTC
This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.7.0, please open a new bug report.

glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution.

[1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939
[2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user

Comment 5 Niels de Vos 2015-05-14 17:47:12 UTC
This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.7.0, please open a new bug report.

glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution.

[1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939
[2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user