Bug 1290677 - tiering: T files getting created , even after disk quota exceeds
Summary: tiering: T files getting created , even after disk quota exceeds
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: GlusterFS
Classification: Community
Component: tiering
Version: mainline
Hardware: x86_64
OS: Linux
unspecified
urgent
Target Milestone: ---
Assignee: Mohammed Rafi KC
QA Contact: bugs@gluster.org
URL:
Whiteboard:
Depends On: 1285797
Blocks: 1260783 1295359
TreeView+ depends on / blocked
 
Reported: 2015-12-11 06:05 UTC by Mohammed Rafi KC
Modified: 2016-06-16 13:50 UTC (History)
11 users (show)

Fixed In Version: glusterfs-3.8rc2
Clone Of: 1285797
: 1295359 (view as bug list)
Environment:
Last Closed: 2016-06-16 13:50:01 UTC
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Embargoed:


Attachments (Terms of Use)

Comment 1 Vijay Bellur 2015-12-11 06:39:42 UTC
REVIEW: http://review.gluster.org/12948 (dht:delete the linkfile if data file creation fails) posted (#2) for review on master by mohammed rafi  kc (rkavunga)

Comment 2 Vijay Bellur 2015-12-12 07:32:10 UTC
REVIEW: http://review.gluster.org/12948 (dht:delete the linkfile if data file creation fails) posted (#3) for review on master by mohammed rafi  kc (rkavunga)

Comment 3 Vijay Bellur 2015-12-21 15:16:31 UTC
REVIEW: http://review.gluster.org/12948 (dht:delete the linkfile if data file creation fails) posted (#4) for review on master by mohammed rafi  kc (rkavunga)

Comment 4 Vijay Bellur 2015-12-21 20:42:10 UTC
REVIEW: http://review.gluster.org/12948 (dht:delete the linkfile if data file creation fails) posted (#5) for review on master by mohammed rafi  kc (rkavunga)

Comment 5 Vijay Bellur 2015-12-22 06:52:44 UTC
REVIEW: http://review.gluster.org/12948 (dht:delete the linkfile if data file creation fails) posted (#6) for review on master by mohammed rafi  kc (rkavunga)

Comment 6 Vijay Bellur 2015-12-22 07:05:23 UTC
REVIEW: http://review.gluster.org/12948 (dht:delete the linkfile if data file creation fails) posted (#7) for review on master by mohammed rafi  kc (rkavunga)

Comment 7 Vijay Bellur 2015-12-22 08:01:04 UTC
REVIEW: http://review.gluster.org/12948 (tier:delete the linkfile if data file creation fails) posted (#8) for review on master by mohammed rafi  kc (rkavunga)

Comment 8 Vijay Bellur 2015-12-22 13:12:00 UTC
COMMIT: http://review.gluster.org/12948 committed in master by Dan Lambright (dlambrig) 
------
commit d3fd13688f850e58bfa517a4c2d17e8fa4343dcf
Author: Mohammed Rafi KC <rkavunga>
Date:   Thu Dec 10 20:13:22 2015 +0530

    tier:delete the linkfile if data file creation fails
    
    If we are creating data file in a hot subvolume
    then we will create a linkfile in cold subvolume.
    Linkfile creation happens first. If linkfile creation
    was successful and data file creation failed, then
    linkfile in cold subvolume will become stale.
    
    This patch will delete the linkfile as well, if data
    file creation fails.
    
    Also this code duplicates dht_create to make tier_create
    
    Change-Id: I377a90dad47f288e9576c7323b23cf694a91a7a3
    BUG: 1290677
    Signed-off-by: Mohammed Rafi KC <rkavunga>
    Reviewed-on: http://review.gluster.org/12948
    Reviewed-by: N Balachandran <nbalacha>
    Tested-by: NetBSD Build System <jenkins.org>
    Reviewed-by: Raghavendra G <rgowdapp>
    Reviewed-by: Dan Lambright <dlambrig>
    Tested-by: Dan Lambright <dlambrig>

Comment 9 Vijay Bellur 2015-12-28 14:09:42 UTC
REVIEW: http://review.gluster.org/13102 (tier/create: Dynamically allocate gfid memory) posted (#1) for review on master by mohammed rafi  kc (rkavunga)

Comment 10 Vijay Bellur 2016-01-02 14:48:00 UTC
REVIEW: http://review.gluster.org/13129 (tier/create: add TIER_LINKFILE_GFID to ignorable xattr) posted (#1) for review on master by mohammed rafi  kc (rkavunga)

Comment 11 Vijay Bellur 2016-01-02 18:12:10 UTC
REVIEW: http://review.gluster.org/13130 (tier/create: store TIER_LINKFILE_GFID in xattr dictionary) posted (#1) for review on master by mohammed rafi  kc (rkavunga)

Comment 12 Mohammed Rafi KC 2016-01-04 09:06:28 UTC
One more patch need to be merged as part of the bug

Comment 13 Vijay Bellur 2016-01-04 12:29:11 UTC
REVIEW: http://review.gluster.org/13130 (tier/create: store TIER_LINKFILE_GFID in xattr dictionary) posted (#2) for review on master by mohammed rafi  kc (rkavunga)

Comment 14 Vijay Bellur 2016-01-04 18:24:22 UTC
REVIEW: http://review.gluster.org/13130 (tier/create: store TIER_LINKFILE_GFID in xattr dictionary) posted (#3) for review on master by mohammed rafi  kc (rkavunga)

Comment 15 Vijay Bellur 2016-01-05 12:42:59 UTC
COMMIT: http://review.gluster.org/13130 committed in master by Dan Lambright (dlambrig) 
------
commit 45b1bf53da028b92ea7fc3f21a53f2a3cb0d8b0c
Author: Mohammed Rafi KC <rkavunga>
Date:   Sat Jan 2 23:34:54 2016 +0530

    tier/create: store TIER_LINKFILE_GFID in xattr dictionary
    
    In tier_create, a new key TIER_LINKFILE_GFID was introduced to
    avoid a race in stale linkfile deletion. Storing this key in
    xattr dictionary instead of using local->params dictionary.
    
    Because local->params dictionary was also used to create the file
    before stale linkfile deletion, that leads posix_create to fail,
    trying to set the added key as extended attributes
    
    Change-Id: I24fecb62b47bee65a1e86103925a67d13304c5df
    BUG: 1290677
    Signed-off-by: Mohammed Rafi KC <rkavunga>
    Reviewed-on: http://review.gluster.org/13130
    Tested-by: Gluster Build System <jenkins.com>
    Reviewed-by: N Balachandran <nbalacha>
    Reviewed-by: Dan Lambright <dlambrig>
    Tested-by: Dan Lambright <dlambrig>

Comment 16 Niels de Vos 2016-06-16 13:50:01 UTC
This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.8.0, please open a new bug report.

glusterfs-3.8.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution.

[1] http://blog.gluster.org/2016/06/glusterfs-3-8-released/
[2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user


Note You need to log in before you can comment on or make changes to this bug.