Bug 1464350

Summary:	[RFE] Posix xlator needs to reserve disk space to prevent the brick from getting full.
Product:	[Red Hat Storage] Red Hat Gluster Storage	Reporter:	Nithya Balachandran <nbalacha>
Component:	posix	Assignee:	Mohit Agrawal <moagrawa>
Status:	CLOSED ERRATA	QA Contact:	Prasad Desala <tdesala>
Severity:	unspecified	Docs Contact:
Priority:	unspecified
Version:	rhgs-3.3	CC:	amukherj, moagrawa, rhs-bugs, sheggodu, srmukher, storage-qa-internal, tdesala
Target Milestone:	---	Keywords:	FutureFeature, ZStream
Target Release:	RHGS 3.4.0
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:	glusterfs-3.12.2-2	Doc Type:	Enhancement
Doc Text:	The POSIX translator is now enhanced with an option that allows user to reserve disk space on the bricks. Some administrative operations, like expanding storage or rebalancing data across nodes, require spare working space on the disk. The storage.reserve option lets users expand disk or cluster when backend bricks are full preventing ENOSPC errors on mount points.	Story Points:	---
Clone Of:
Clones:	1471366 1476158 (view as bug list)		Environment:
Last Closed:	2018-09-04 06:32:36 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:
Bug Blocks:	1173519, 1286092, 1398595, 1471366, 1476158, 1503132

Description Nithya Balachandran 2017-06-23 07:48:41 UTC

Description of problem:

Once a brick becomes completely (100%) full, the gluster filesystem becomes inconsistent as xattr operations fail and recovery is very difficult.

A rebalance cannot be used to migrate data off the full brick as xattr operations will fail.

DHT uses a min-free-disk option to try to keep some reserve space on all bricks. However, this approach is not fool proof and should ideally be handled by the posix xlator. 

Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

Comment 3 Mohit Agrawal 2017-07-17 01:57:36 UTC

Patch is posted on upstream 

https://review.gluster.org/#/c/17780/

Comment 7 Prasad Desala 2018-03-12 13:58:21 UTC

Verified this RFE on glusterfs version: 3.12.2-5.el7rhgs.x86_64

1) Able to set/reset storage.reserve volume set option.
2) Reserved the space to 50% and created files using dd created files. Once the backend bricks reached the reserved space, file creation is failing with ENOSPC errors.

I have filed below BZs while testing this RFE,
https://bugzilla.redhat.com/show_bug.cgi?id=1554291
https://bugzilla.redhat.com/show_bug.cgi?id=1550991
https://bugzilla.redhat.com/show_bug.cgi?id=1550982
https://bugzilla.redhat.com/show_bug.cgi?id=1554298

Moving this BZ to Verified considering the basic functional is working and have bugs filed for the seen issues. Will file new BZs on this feature if seen during our regression testing.

Comment 9 errata-xmlrpc 2018-09-04 06:32:36 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2018:2607

Comment 10 Red Hat Bugzilla 2023-09-14 03:59:44 UTC

The needinfo request[s] on this closed bug have been removed as they have been unresolved for 1000 days