Bug 812770

Summary:	Removing multiple bricks simultaneously causes data loss
Product:	[Community] GlusterFS	Reporter:	shylesh <shmohan>
Component:	core	Assignee:	Amar Tumballi <amarts>
Status:	CLOSED CURRENTRELEASE	QA Contact:
Severity:	urgent	Docs Contact:
Priority:	urgent
Version:	pre-release	CC:	gluster-bugs, rfortier, vraman
Target Milestone:	---
Target Release:	---
Hardware:	x86_64
OS:	Linux
Whiteboard:
Fixed In Version:	glusterfs-3.4.0	Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2013-07-24 18:01:32 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:	3.3.0qa36	Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:
Bug Blocks:	817967

Description shylesh 2012-04-16 08:00:15 UTC

Description of problem:
Removing multiple bricks at the same time causes data loss

Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1. create a distribute volume with 3 bricks
2. fill up with some data and count the number of files created
3. Now start remove-brick after the remove-brick completes commit the operation
4. check the number of files on the mount point 
  
Actual results:
After Remove-brick commit causes data loss.


Expected results:


Additional info:

Comment 1 shylesh 2012-04-16 08:01:22 UTC

Remove multiple bricks at the same time, actually this scenario is causing data loss.

Comment 2 Amar Tumballi 2012-04-17 11:01:50 UTC

not able to reproducible even in Shylesh's setup (also in my setup). Asked him to run it multiple times, if not reproduced, we should take this out from beta blocker

Comment 3 Amar Tumballi 2012-04-17 19:07:13 UTC

sent a patch for fixing the issue of remove-brick (more than 2 bricks involving two different nodes) at http://review.gluster.com/3173. Need to test this before committing.

Shylesh, please fetch the patch and run the tests, confirm the behavior.

Comment 4 Anand Avati 2012-04-18 13:25:47 UTC

CHANGE: http://review.gluster.com/3173 (glusterd (remove-brick): fix data-loss issue) merged in master by Vijay Bellur (vijay)

Comment 5 shylesh 2012-04-20 10:01:13 UTC

Works fine  on 3.3.0qa36