Bug 1212084

Summary:	Data Tiering: Detaching tier from a normal disperse volume seems to destroy/lose EC(disperse) properties and shows volume type as dist-disperse
Product:	[Community] GlusterFS	Reporter:	Nag Pavan Chilakam <nchilaka>
Component:	tiering	Assignee:	Dan Lambright <dlambrig>
Status:	CLOSED DUPLICATE	QA Contact:	bugs <bugs>
Severity:	urgent	Docs Contact:
Priority:	urgent
Version:	mainline	CC:	bugs, dlambrig
Target Milestone:	---	Keywords:	Triaged
Target Release:	---
Hardware:	Unspecified
OS:	Linux
Whiteboard:
Fixed In Version:		Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2015-05-20 05:51:19 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:	1214048, 1219608
Bug Blocks:	1186580, 1260923

Description Nag Pavan Chilakam 2015-04-15 14:09:45 UTC

Description of problem:
======================
When we create a normal disperse volume and then attach a tier and detach a tier, then following issues are seen:
1)the volume shows as distribute-disperse instead of just disperse
2)if we create files on this volume after detach, the files go to only one brick instead of getting written in EC fashion(spreading chunks on all bricks)

Version-Release number of selected component (if applicable):
============================================================
[root@vertigo ~]# gluster --version
glusterfs 3.7dev built on Apr 13 2015 07:14:27
Repository revision: git://git.gluster.com/glusterfs.git
Copyright (c) 2006-2011 Gluster Inc. <http://www.gluster.com>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
You may redistribute copies of GlusterFS under the terms of the GNU General Public License.
[root@vertigo ~]# rpm -qa|grep gluster
glusterfs-server-3.7dev-0.994.gitf522001.el6.x86_64
glusterfs-rdma-3.7dev-0.994.gitf522001.el6.x86_64
glusterfs-api-3.7dev-0.994.gitf522001.el6.x86_64
glusterfs-regression-tests-3.7dev-0.994.gitf522001.el6.x86_64
glusterfs-3.7dev-0.994.gitf522001.el6.x86_64
glusterfs-devel-3.7dev-0.994.gitf522001.el6.x86_64
glusterfs-resource-agents-3.7dev-0.994.gitf522001.el6.noarch
glusterfs-libs-3.7dev-0.994.gitf522001.el6.x86_64
glusterfs-fuse-3.7dev-0.994.gitf522001.el6.x86_64
glusterfs-geo-replication-3.7dev-0.994.gitf522001.el6.x86_64
glusterfs-cli-3.7dev-0.994.gitf522001.el6.x86_64
glusterfs-api-devel-3.7dev-0.994.gitf522001.el6.x86_64
glusterfs-extra-xlators-3.7dev-0.994.gitf522001.el6.x86_64
glusterfs-debuginfo-3.7dev-0.994.gitf522001.el6.x86_64


Steps to Reproduce:
===================
1.create a EC volume(without any distribute) as below
[root@vertigo ~]# gluster v create dispvol redundancy 4 vertigo:/rhs/brick1/dispvol-1 ninja:/rhs/brick1/dispvol-2 vertigo:/rhs/brick2/dispvol-3 ninja:/rhs/brick2/dispvol-4 vertigo:/rhs/brick3/dispvol-5 ninja:/rhs/brick3/dispvol-6 vertigo:/rhs/brick4/dispvol-7 ninja:/rhs/brick4/dispvol-8 vertigo:/rhs/brick1/dispvol-9 ninja:/rhs/brick1/dispvol-10 vertigo:/rhs/brick2/dispvol-11 ninja:/rhs/brick2/dispvol-12 force
volume create: dispvol: success: please start the volume to access data
[root@vertigo ~]# gluster v start dispvol
volume start: dispvol: success
[root@vertigo ~]# gluster v info dispvol
 
Volume Name: dispvol
Type: Disperse
Volume ID: 5714d8ad-b228-46c4-a893-a0a660731b48
Status: Started
Number of Bricks: 1 x (8 + 4) = 12
Transport-type: tcp
Bricks:
Brick1: vertigo:/rhs/brick1/dispvol-1
Brick2: ninja:/rhs/brick1/dispvol-2
Brick3: vertigo:/rhs/brick2/dispvol-3
Brick4: ninja:/rhs/brick2/dispvol-4
Brick5: vertigo:/rhs/brick3/dispvol-5
Brick6: ninja:/rhs/brick3/dispvol-6
Brick7: vertigo:/rhs/brick4/dispvol-7
Brick8: ninja:/rhs/brick4/dispvol-8
Brick9: vertigo:/rhs/brick1/dispvol-9
Brick10: ninja:/rhs/brick1/dispvol-10
Brick11: vertigo:/rhs/brick2/dispvol-11
Brick12: ninja:/rhs/brick2/dispvol-12
[root@vertigo ~]# gluster v status dispvol
Status of volume: dispvol
Gluster process                             TCP Port  RDMA Port  Online  Pid
------------------------------------------------------------------------------
Brick vertigo:/rhs/brick1/dispvol-1         49193     0          Y       841  
Brick ninja:/rhs/brick1/dispvol-2           49193     0          Y       6008 
Brick vertigo:/rhs/brick2/dispvol-3         49194     0          Y       858  
Brick ninja:/rhs/brick2/dispvol-4           49194     0          Y       6025 
Brick vertigo:/rhs/brick3/dispvol-5         49195     0          Y       875  
Brick ninja:/rhs/brick3/dispvol-6           49195     0          Y       6042 
Brick vertigo:/rhs/brick4/dispvol-7         49196     0          Y       892  
Brick ninja:/rhs/brick4/dispvol-8           49196     0          Y       6059 
Brick vertigo:/rhs/brick1/dispvol-9         49197     0          Y       909  
Brick ninja:/rhs/brick1/dispvol-10          49197     0          Y       6076 
Brick vertigo:/rhs/brick2/dispvol-11        49198     0          Y       926  
Brick ninja:/rhs/brick2/dispvol-12          49198     0          Y       6102 
NFS Server on localhost                     2049      0          Y       944  
NFS Server on ninja                         2049      0          Y       6120 
NFS Server on interstellar                  2049      0          Y       65083
NFS Server on transformers                  2049      0          Y       62841
 
Task Status of Volume dispvol
------------------------------------------------------------------------------
There are no active volume tasks
 
[root@vertigo ~]# 

[root@vertigo ~]# 
[root@vertigo ~]# 
[root@vertigo ~]# getfattr -d -m . -e hex  /rhs/brick*/disp*
getfattr: Removing leading '/' from absolute path names
# file: rhs/brick1/dispvol-1
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000002
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48

# file: rhs/brick1/dispvol-9
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000002
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48

# file: rhs/brick2/dispvol-11
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000002
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48

# file: rhs/brick2/dispvol-3
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000002
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48

# file: rhs/brick3/dispvol-5
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000002
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48

# file: rhs/brick4/dispvol-7
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000002
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48

[root@ninja ~]# ###########################################################################
[root@ninja ~]# 
[root@ninja ~]# 
[root@ninja ~]# 
[root@ninja ~]# 
[root@ninja ~]# 
[root@ninja ~]# getfattr -d -m . -e hex  /rhs/brick*/disp*
getfattr: Removing leading '/' from absolute path names
# file: rhs/brick1/dispvol-10
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000002
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48

# file: rhs/brick1/dispvol-2
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000002
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48

# file: rhs/brick2/dispvol-12
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000002
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48

# file: rhs/brick2/dispvol-4
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000002
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48

# file: rhs/brick3/dispvol-6
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000002
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48

# file: rhs/brick4/dispvol-8
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000002
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48

[root@ninja ~]# 



2. Attach a hot tier as below:
[root@vertigo ~]# 
[root@vertigo ~]# gluster v attach-tier dispvol replica 2 vertigo:/rhs/brick1/dispvol-tier ninja:/rhs/brick1/dispvol-tier force
volume add-brick: success
[root@vertigo ~]# gluster v info dispvol
 
Volume Name: dispvol
Type: Tier
Volume ID: 5714d8ad-b228-46c4-a893-a0a660731b48
Status: Started
Number of Bricks: 7 x 2 = 14
Transport-type: tcp
Bricks:
Brick1: ninja:/rhs/brick1/dispvol-tier
Brick2: vertigo:/rhs/brick1/dispvol-tier
Brick3: vertigo:/rhs/brick1/dispvol-1
Brick4: ninja:/rhs/brick1/dispvol-2
Brick5: vertigo:/rhs/brick2/dispvol-3
Brick6: ninja:/rhs/brick2/dispvol-4
Brick7: vertigo:/rhs/brick3/dispvol-5
Brick8: ninja:/rhs/brick3/dispvol-6
Brick9: vertigo:/rhs/brick4/dispvol-7
Brick10: ninja:/rhs/brick4/dispvol-8
Brick11: vertigo:/rhs/brick1/dispvol-9
Brick12: ninja:/rhs/brick1/dispvol-10
Brick13: vertigo:/rhs/brick2/dispvol-11
Brick14: ninja:/rhs/brick2/dispvol-12
[root@vertigo ~]# 
[root@vertigo ~]# 
[root@vertigo ~]# getfattr -d -m . -e hex  /rhs/brick*/disp*
getfattr: Removing leading '/' from absolute path names
# file: rhs/brick1/dispvol-1
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

# file: rhs/brick1/dispvol-9
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

# file: rhs/brick1/dispvol-tier
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.afr.dirty=0x000000000000000000000000
trusted.afr.dispvol-client-12=0x000000000000000000000000
trusted.afr.dispvol-client-13=0x000000000000000000000000
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x0000000100000000e3839644ffffffff

# file: rhs/brick2/dispvol-11
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

# file: rhs/brick2/dispvol-3
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

# file: rhs/brick3/dispvol-5
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

# file: rhs/brick4/dispvol-7
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

[root@vertigo ~]# 








##################


[root@ninja ~]# ###########################################################################
[root@ninja ~]# ###########################################################################
[root@ninja ~]# getfattr -d -m . -e hex  /rhs/brick*/disp*
getfattr: Removing leading '/' from absolute path names
# file: rhs/brick1/dispvol-10
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

# file: rhs/brick1/dispvol-2
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

# file: rhs/brick1/dispvol-tier
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.afr.dirty=0x000000000000000000000000
trusted.afr.dispvol-client-12=0x000000000000000000000000
trusted.afr.dispvol-client-13=0x000000000000000000000000
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x0000000100000000e3839644ffffffff

# file: rhs/brick2/dispvol-12
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

# file: rhs/brick2/dispvol-4
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

# file: rhs/brick3/dispvol-6
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

# file: rhs/brick4/dispvol-8
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

[root@ninja ~]# 



3. Then detach above tier 
root@vertigo ~]# gluster v status dispvol
Status of volume: dispvol
Gluster process                             TCP Port  RDMA Port  Online  Pid
------------------------------------------------------------------------------
Brick ninja:/rhs/brick1/dispvol-tier        49199     0          Y       6231 
Brick vertigo:/rhs/brick1/dispvol-tier      49199     0          Y       1082 
Brick vertigo:/rhs/brick1/dispvol-1         49193     0          Y       841  
Brick ninja:/rhs/brick1/dispvol-2           49193     0          Y       6008 
Brick vertigo:/rhs/brick2/dispvol-3         49194     0          Y       858  
Brick ninja:/rhs/brick2/dispvol-4           49194     0          Y       6025 
Brick vertigo:/rhs/brick3/dispvol-5         49195     0          Y       875  
Brick ninja:/rhs/brick3/dispvol-6           49195     0          Y       6042 
Brick vertigo:/rhs/brick4/dispvol-7         49196     0          Y       892  
Brick ninja:/rhs/brick4/dispvol-8           49196     0          Y       6059 
Brick vertigo:/rhs/brick1/dispvol-9         49197     0          Y       909  
Brick ninja:/rhs/brick1/dispvol-10          49197     0          Y       6076 
Brick vertigo:/rhs/brick2/dispvol-11        49198     0          Y       926  
Brick ninja:/rhs/brick2/dispvol-12          49198     0          Y       6102 
NFS Server on localhost                     2049      0          Y       1106 
NFS Server on ninja                         2049      0          Y       6255 
NFS Server on interstellar                  2049      0          Y       65191
NFS Server on transformers                  2049      0          Y       62951
 
Task Status of Volume dispvol
------------------------------------------------------------------------------
There are no active volume tasks
 
[root@vertigo ~]# gluster v detach-tier dispvol
volume remove-brick unknown: success







Actual results:
===============
Now on issuing vol info, it shows vol type as below which is wrong:
[root@vertigo ~]# gluster v info dispvol
 
Volume Name: dispvol
Type: Distributed-Disperse
Volume ID: 5714d8ad-b228-46c4-a893-a0a660731b48
Status: Started
Number of Bricks: 6 x (8 + 4) = 12
Transport-type: tcp
Bricks:
Brick1: vertigo:/rhs/brick1/dispvol-1
Brick2: ninja:/rhs/brick1/dispvol-2
Brick3: vertigo:/rhs/brick2/dispvol-3
Brick4: ninja:/rhs/brick2/dispvol-4
Brick5: vertigo:/rhs/brick3/dispvol-5
Brick6: ninja:/rhs/brick3/dispvol-6
Brick7: vertigo:/rhs/brick4/dispvol-7
Brick8: ninja:/rhs/brick4/dispvol-8
Brick9: vertigo:/rhs/brick1/dispvol-9
Brick10: ninja:/rhs/brick1/dispvol-10
Brick11: vertigo:/rhs/brick2/dispvol-11
Brick12: ninja:/rhs/brick2/dispvol-12
[root@vertigo ~]# 



Also, i created files about 30 of them and they got creeated only in one brick which is not acting as an ec volume


[root@vertigo ~]# ls /rhs/brick*/disp*
/rhs/brick1/dispvol-1:

/rhs/brick1/dispvol-9:
f1  f10  f11  f12  f13  f14  f15  f16  f17  f18  f19  f2  f20  f21  f22  f23  f24  f25  f26  f27  f28  f29  f3  f30  f4  f5  f6  f7  f8  f9

/rhs/brick1/dispvol-tier:

/rhs/brick2/dispvol-11:

/rhs/brick2/dispvol-3:

/rhs/brick3/dispvol-5:

/rhs/brick4/dispvol-7:
[root@vertigo ~]# 



[root@ninja ~]# ls /rhs/brick*/disp*
/rhs/brick1/dispvol-10:

/rhs/brick1/dispvol-2:

/rhs/brick1/dispvol-tier:

/rhs/brick2/dispvol-12:

/rhs/brick2/dispvol-4:

/rhs/brick3/dispvol-6:

/rhs/brick4/dispvol-8:
[root@ninja ~]# 




[root@ninja ~]# getfattr -d -m . -e hex  /rhs/brick*/disp*
getfattr: Removing leading '/' from absolute path names
# file: rhs/brick1/dispvol-10
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

# file: rhs/brick1/dispvol-2
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

# file: rhs/brick1/dispvol-tier
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.afr.dirty=0x000000000000000000000000
trusted.afr.dispvol-client-12=0x000000000000000000000000
trusted.afr.dispvol-client-13=0x000000000000000000000000
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x0000000100000000e3839644ffffffff

# file: rhs/brick2/dispvol-12
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

# file: rhs/brick2/dispvol-4
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

# file: rhs/brick3/dispvol-6
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

# file: rhs/brick4/dispvol-8
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643


[root@vertigo ~]# 
[root@vertigo ~]# getfattr -d -m . -e hex  /rhs/brick*/disp*
getfattr: Removing leading '/' from absolute path names
# file: rhs/brick1/dispvol-1
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

# file: rhs/brick1/dispvol-9
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

# file: rhs/brick1/dispvol-tier
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.afr.dirty=0x000000000000000000000000
trusted.afr.dispvol-client-12=0x000000000000000000000000
trusted.afr.dispvol-client-13=0x000000000000000000000000
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x0000000100000000e3839644ffffffff

# file: rhs/brick2/dispvol-11
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

# file: rhs/brick2/dispvol-3
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

# file: rhs/brick3/dispvol-5
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

# file: rhs/brick4/dispvol-7
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.ec.version=0x0000000000000004
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.dht=0x000000010000000000000000ffffffff
trusted.glusterfs.volume-id=0x5714d8adb22846c4a893a0a660731b48
trusted.tier-gfid=0x000000010000000000000000e3839643

[root@vertigo ~]# 






Expected results:


Additional info:

Comment 1 Anand Avati 2015-04-22 00:40:48 UTC

REVIEW: http://review.gluster.org/10326 (glusterd: make detach-tier work with dispersed vols) posted (#1) for review on master by Dan Lambright (dlambrig)

Comment 2 Dan Lambright 2015-05-20 05:51:19 UTC


*** This bug has been marked as a duplicate of bug 1214048 ***