Bug 1304988 - DHT: Rebalance hang while migrating the files of disperse volume
Summary: DHT: Rebalance hang while migrating the files of disperse volume
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: GlusterFS
Classification: Community
Component: disperse
Version: mainline
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
Assignee: Ashish Pandey
QA Contact: Bhaskarakiran
URL:
Whiteboard:
Depends On: 1264310
Blocks: 1322299
TreeView+ depends on / blocked
 
Reported: 2016-02-05 08:49 UTC by Ashish Pandey
Modified: 2016-11-23 23:12 UTC (History)
7 users (show)

Fixed In Version: glusterfs-3.8.0
Doc Type: Bug Fix
Doc Text:
Clone Of: 1264310
: 1322299 (view as bug list)
Environment:
Last Closed: 2016-06-23 08:43:13 UTC
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Embargoed:


Attachments (Terms of Use)

Comment 1 Vijay Bellur 2016-02-17 10:31:33 UTC
REVIEW: http://review.gluster.org/13460 (cluster/ec: Rebalance hangs during rename) posted (#1) for review on master by Ashish Pandey (aspandey)

Comment 2 Vijay Bellur 2016-02-23 05:38:01 UTC
REVIEW: http://review.gluster.org/13460 (cluster/ec: Rebalance hangs during rename) posted (#2) for review on master by Ashish Pandey (aspandey)

Comment 3 Vijay Bellur 2016-02-23 09:12:54 UTC
REVIEW: http://review.gluster.org/13460 (cluster/ec: Rebalance hangs during rename) posted (#3) for review on master by Ashish Pandey (aspandey)

Comment 4 Vijay Bellur 2016-02-24 18:47:07 UTC
REVIEW: http://review.gluster.org/13460 (cluster/ec: Rebalance hangs during rename) posted (#4) for review on master by Ashish Pandey (aspandey)

Comment 5 Vijay Bellur 2016-03-07 11:34:44 UTC
REVIEW: http://review.gluster.org/13460 (cluster/ec: Rebalance hangs during rename) posted (#5) for review on master by Ashish Pandey (aspandey)

Comment 6 Vijay Bellur 2016-03-08 07:10:56 UTC
REVIEW: http://review.gluster.org/13460 (cluster/ec: Rebalance hangs during rename) posted (#6) for review on master by Ashish Pandey (aspandey)

Comment 7 Vijay Bellur 2016-03-09 06:39:51 UTC
REVIEW: http://review.gluster.org/13460 (cluster/ec: Rebalance hangs during rename) posted (#7) for review on master by Ashish Pandey (aspandey)

Comment 8 Vijay Bellur 2016-03-10 05:03:06 UTC
REVIEW: http://review.gluster.org/13460 (cluster/ec: Rebalance hangs during rename) posted (#8) for review on master by Ashish Pandey (aspandey)

Comment 9 Vijay Bellur 2016-03-16 10:55:17 UTC
REVIEW: http://review.gluster.org/13460 (cluster/ec: Rebalance hangs during rename) posted (#9) for review on master by Ashish Pandey (aspandey)

Comment 10 Vijay Bellur 2016-03-16 11:24:27 UTC
REVIEW: http://review.gluster.org/13460 (cluster/ec: Rebalance hangs during rename) posted (#10) for review on master by Ashish Pandey (aspandey)

Comment 11 Vijay Bellur 2016-03-17 07:21:23 UTC
REVIEW: http://review.gluster.org/13460 (cluster/ec: Rebalance hangs during rename) posted (#11) for review on master by Ashish Pandey (aspandey)

Comment 12 Vijay Bellur 2016-03-17 16:46:43 UTC
REVIEW: http://review.gluster.org/13460 (cluster/ec: Rebalance hangs during rename) posted (#12) for review on master by Ashish Pandey (aspandey)

Comment 13 Vijay Bellur 2016-03-20 09:38:57 UTC
REVIEW: http://review.gluster.org/13460 (cluster/ec: Rebalance hangs during rename) posted (#13) for review on master by Ashish Pandey (aspandey)

Comment 14 Mike McCune 2016-03-28 22:17:27 UTC
This bug was accidentally moved from POST to MODIFIED via an error in automation, please see mmccune with any questions

Comment 15 Vijay Bellur 2016-03-30 08:51:17 UTC
COMMIT: http://review.gluster.org/13460 committed in master by Pranith Kumar Karampuri (pkarampu) 
------
commit 7bbcd6fb692dffc628b723eace8cfcfa466e606f
Author: Ashish Pandey <aspandey>
Date:   Wed Feb 17 15:57:02 2016 +0530

    cluster/ec: Rebalance hangs during rename
    
    Problem:
    During the rename of a particular file (ec
    is holding blocking inodelk on the parent
    directory), if the rename of another file
    under the same directory comes. EC does not
    release the lock and goes ahead and renames
    the "new" file with the "already held lock".
    
    That causes rebalance process to be blocked
    on a lock which has been acquired by rename.
    
    Solution:
    While rename fop comes, ec takes blocking inodelk
    on old and new parent of the file. Before releasing,
    every lock held by ec, it waits for some "time" to
    see if that lock can be reused by the next fop.
    If within this "time" some other request comes,
    it releases this lock based on condition
    "lock count > 1"
    
    To get this "lock count" for rename fop, we have
    implemented "pl_rename" in feature/lock. Also,
    on ec side, changed the condition to release the lock
    based on the type of fop and old and new parent
    directories.
    
    Change-Id: I979dbab1185df962e8f305a6074ae1186ffe7db0
    Bug: 1304988
    Signed-off-by: Ashish Pandey <aspandey>
    Reviewed-on: http://review.gluster.org/13460
    Smoke: Gluster Build System <jenkins.com>
    NetBSD-regression: NetBSD Build System <jenkins.org>
    CentOS-regression: Gluster Build System <jenkins.com>
    Reviewed-by: Pranith Kumar Karampuri <pkarampu>
    Reviewed-by: Krutika Dhananjay <kdhananj>

Comment 16 Vijay Bellur 2016-04-01 08:13:19 UTC
REVIEW: http://review.gluster.org/13883 (feature/locks : Add pl-messages.h file in Makefile.am) posted (#1) for review on master by Ashish Pandey (aspandey)

Comment 17 Vijay Bellur 2016-04-01 08:48:18 UTC
REVIEW: http://review.gluster.org/13883 (feature/locks : Add pl-messages.h file in Makefile.am) posted (#2) for review on master by Ashish Pandey (aspandey)

Comment 18 Niels de Vos 2016-06-23 08:43:13 UTC
This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.8.0, please open a new bug report.

glusterfs-3.8.0 has been announced on the Gluster mailinglists [1] a while back, and packages for several distributions should be available by now.

[1] http://blog.gluster.org/2016/06/glusterfs-3-8-released/


Note You need to log in before you can comment on or make changes to this bug.