Bug 1145681 - Rebalancing Issue in distributed volume
Summary: Rebalancing Issue in distributed volume
Keywords:
Status: CLOSED EOL
Alias: None
Product: GlusterFS
Classification: Community
Component: distribute
Version: 3.5.1
Hardware: x86_64
OS: Linux
medium
medium
Target Milestone: ---
Assignee: Raghavendra G
QA Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2014-09-23 13:39 UTC by NOVELTIS IT
Modified: 2020-08-06 08:49 UTC (History)
6 users (show)

Fixed In Version:
Clone Of:
Environment:
Last Closed: 2016-06-17 15:57:32 UTC
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Embargoed:


Attachments (Terms of Use)

Description NOVELTIS IT 2014-09-23 13:39:52 UTC
Description of problem:
I am in a 3 hosts/3 bricks cluster configuration (Debian), with a single distributed volume.

Because I would like to change the FS of my bricks from xfs to ext4 (xfs is to slow with small files) I performed the following commands :
- remove a brick
- commit the removal
- add the new brick to the pool
- launch rebalancing

The rebalancing finished successfully with some skipped files :
http://pastebin.com/wekv3CRv

The problem is that every skipped files are present at two several location :
- on its source brick : the file is consistent
- on its destination brick : the file is corrupted

Here is an example :
# ls -lrt /glusterfs/projets-brick1/some_folder/file.dat 
-rw-rw----+ 2 some_user some_group 32302 Sep  5 10:34 /glusterfs/projets-brick1/some_folder/file.dat 

# ls -lrt /glusterfs/projets-brick2/some_folder/file.dat 
-rw-rw---T+ 2 some_user some_group 32302 Sep 19 10:01 /glusterfs/projets-brick2/some_folder/file.dat

The difference between the two files is the modification date. One has the good date (in this case brick1) unlike the other file  (and corrupted) has the rebalancing date (in this case brick2).

On the client (direct glusterfs mount or glusterfs over CIFS) each time we refresh the file, the modification date changed. I concluded that one time it was pointing to a brick and the second time to the other brick.

I need to perform these steps twice again, in order to change all my brick's FS type. I would like to be more serene before to continue.

Thx.
T-

Comment 2 Niels de Vos 2016-06-17 15:57:32 UTC
This bug is getting closed because the 3.5 is marked End-Of-Life. There will be no further updates to this version. Please open a new bug against a version that still receives bugfixes if you are still facing this issue in a more current release.


Note You need to log in before you can comment on or make changes to this bug.