Bug 874554
Summary: | cluster.min-free-disk not having an effect on new files | |||
---|---|---|---|---|
Product: | [Community] GlusterFS | Reporter: | Pete J <pete.jefferson> | |
Component: | distribute | Assignee: | Raghavendra Talur <rtalur> | |
Status: | CLOSED CURRENTRELEASE | QA Contact: | ||
Severity: | unspecified | Docs Contact: | ||
Priority: | medium | |||
Version: | 3.3.0 | CC: | amarts, bhubbard, fharshav, gluster-bugs, kaushal, vbellur | |
Target Milestone: | --- | |||
Target Release: | --- | |||
Hardware: | Unspecified | |||
OS: | Linux | |||
Whiteboard: | ||||
Fixed In Version: | glusterfs-3.4.0 | Doc Type: | Bug Fix | |
Doc Text: | Story Points: | --- | ||
Clone Of: | ||||
: | 970813 (view as bug list) | Environment: | ||
Last Closed: | 2013-07-24 17:45:25 UTC | Type: | Bug | |
Regression: | --- | Mount Type: | --- | |
Documentation: | --- | CRM: | ||
Verified Versions: | Category: | --- | ||
oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | ||
Cloudforms Team: | --- | Target Upstream Version: | ||
Embargoed: | ||||
Bug Depends On: | ||||
Bug Blocks: | 970813, 1110651, 1122920 |
Description
Pete J
2012-11-08 12:44:14 UTC
Hi Pete, With 3.3.0 branch, I have not been able to reproduce the issue at hand. Could you please upload the client logs? Hi pete, Can you confirm, whether the issue is still being seen? Pete, also see how does 3.4.0qa releases work out for you. (qa6 is the latest for now). Where can I download 3.4.0qa for Ubuntu 12.04? The qa repos(centos) are available @ http://bits.gluster.org/pub/gluster/glusterfs/ Alternatively, clone source from https://github.com/gluster/glusterfs.git and checkout out required branch or use https://github.com/gluster/glusterfs/tree/v3.4.0qa6 link to download zip files directly. http://review.gluster.org/4420 was last of the patches to get the feature working. REVIEW: http://review.gluster.org/4839 (cluster/dht: Correct min_free_disk behaviour) posted (#1) for review on release-3.3 by Varun Shastry (vshastry) COMMIT: http://review.gluster.org/4839 committed in release-3.3 by Vijay Bellur (vbellur) ------ commit 0ab16bb29a2e242714a76a3bad31921142c7dd35 Author: Varun Shastry <vshastry> Date: Tue Apr 16 12:11:17 2013 +0530 cluster/dht: Correct min_free_disk behaviour Problem: Files were being created in subvol which had less than min_free_disk available even in the cases where other subvols with more space were available. Solution: Changed the logic to look for subvol which has more space available. In cases where all the subvols have lesser than Min_free_disk available , the one with max space and atleast one inode is available. Known Issue: Cannot ensure that first file that is created right after min-free-value is crossed on a brick will get created in other brick because disk usage stat takes some time to update in glusterprocess. Will fix that as part of another bug. Change-Id: Icaba552db053ad8b00be0914b1f4853fb7661bd3 BUG: 874554 Signed-off-by: Raghavendra Talur <rtalur> Signed-off-by: Varun Shastry <vshastry> Reviewed-on: http://review.gluster.org/4839 Tested-by: Gluster Build System <jenkins.com> Reviewed-by: Vijay Bellur <vbellur> Hi there, I've finally had the chance to re-test and the behaviour is still the same. I'm using glusterfs 3.4.0qa8 on Centos 6.4. Again I started out with 2x1GB bricks and loaded them up with files. The volume status is the following: gluster> volume status gv0 detail Status of volume: gv0 ------------------------------------------------------------------------------ Brick : Brick 10.100.2.6:/export/brick1 Port : 49153 Online : Y Pid : 27502 File System : xfs Device : /dev/sdb Mount Options : rw Inode Size : 512 Disk Space Free : 16014MB Total Disk Space : 1014.0MB Inode Count : 328296 Free Inodes : 328042 ------------------------------------------------------------------------------ Brick : Brick 10.100.2.11:/export/brick1 Port : 49153 Online : Y Pid : 2699 File System : xfs Device : /dev/sdb Mount Options : rw Inode Size : 512 Disk Space Free : 9.6MB Total Disk Space : 1014.0MB Inode Count : 20136 Free Inodes : 19880 If I attempt to write a ~30MB file it fails as it looks like it's going to 10.100.2.11. The volume status confirms that: gluster> volume status gv0 detail Status of volume: gv0 ------------------------------------------------------------------------------ Brick : Brick 10.100.2.6:/export/brick1 Port : 49153 Online : Y Pid : 27502 File System : xfs Device : /dev/sdb Mount Options : rw Inode Size : 512 Disk Space Free : 160.1MB Total Disk Space : 1014.0MB Inode Count : 328296 Free Inodes : 328042 ------------------------------------------------------------------------------ Brick : Brick 10.100.2.11:/export/brick1 Port : 49153 Online : Y Pid : 2699 File System : xfs Device : /dev/sdb Mount Options : rw Inode Size : 512 Disk Space Free : 20.0KB Total Disk Space : 1014.0MB Inode Count : 424 Free Inodes : 165 From what I understand from the fix made, if I add another brick the file should go to that new brick as it has sufficient free space. Or, it could be either the new brick or 10.100.2.6 as it has sufficient space and is below the free space threshold. So I add a new brick: gluster> volume add-brick gv0 10.100.2.14:/export/brick1 volume add-brick: success And a rebalance: gluster> volume rebalance gv0 And then try to write the file again - which fails. The volume status shows: gluster> volume status gv0 detail Status of volume: gv0 ------------------------------------------------------------------------------ Brick : Brick 10.100.2.6:/export/brick1 Port : 49153 Online : Y Pid : 27502 File System : xfs Device : /dev/sdb Mount Options : rw Inode Size : 512 Disk Space Free : 114.3MB Total Disk Space : 1014.0MB Inode Count : 234376 Free Inodes : 234120 ------------------------------------------------------------------------------ Brick : Brick 10.100.2.11:/export/brick1 Port : 49153 Online : Y Pid : 2699 File System : xfs Device : /dev/sdb Mount Options : rw Inode Size : 512 Disk Space Free : 24.0KB Total Disk Space : 1014.0MB Inode Count : 432 Free Inodes : 173 ------------------------------------------------------------------------------ Brick : Brick 10.100.2.14:/export/brick1 Port : 49153 Online : Y Pid : 2748 File System : xfs Device : /dev/sdb Mount Options : rw Inode Size : 512 Disk Space Free : 981.7MB Total Disk Space : 1014.0MB Inode Count : 524288 Free Inodes : 524248 Hi Pete, Please provide us the log for this volume. Also, what was the min-free-disk value set to? REVIEW: http://review.gluster.org/7687 (tests: min-free-disk test was incomplete) posted (#3) for review on master by Harshavardhana (harsha) COMMIT: http://review.gluster.org/7687 committed in master by Vijay Bellur (vbellur) ------ commit 47c33dd27150039a6e5e3295eacd8d2d5a7e0ce0 Author: Harshavardhana <harsha> Date: Tue May 6 14:38:40 2014 -0700 tests: min-free-disk test was incomplete - use '%' when we mean it for clarity - in bash we need to evaluate counter decrements Change-Id: Ibd17126945e8a335fa2671d658a2e0c71049fd1e BUG: 874554 Signed-off-by: Harshavardhana <harsha> Reviewed-on: http://review.gluster.org/7687 Tested-by: Gluster Build System <jenkins.com> Reviewed-by: Raghavendra Talur <rtalur> Reviewed-by: Vijay Bellur <vbellur> |