Bug 1207204

Summary: Data Tiering:Adding tier to Disperse(erasure code) volume is converting volume to distribute-disperse instead of tier-disperse type
Product: [Community] GlusterFS Reporter: Nag Pavan Chilakam <nchilaka>
Component: tieringAssignee: Joseph Elwin Fernandes <josferna>
Status: CLOSED CURRENTRELEASE QA Contact:
Severity: urgent Docs Contact:
Priority: high    
Version: mainlineCC: bugs, dlambrig, sankarshan, sasundar
Target Milestone: ---Keywords: Triaged
Target Release: ---   
Hardware: Unspecified   
OS: Linux   
Whiteboard:
Fixed In Version: glusterfs-3.7dev-0.869.gitf5e4c94.el6 Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of:
: 1229239 (view as bug list) Environment:
Last Closed: 2016-02-14 03:58:23 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1186580, 1229239, 1260923    

Description Nag Pavan Chilakam 2015-03-30 12:26:00 UTC
Description of problem:


Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

Comment 1 Nag Pavan Chilakam 2015-03-31 06:34:40 UTC
Submitted by mistake before filling in the info. Hence adding the info

Description of problem:
======================
When i tried to add a tier to EC volume, the bricks were consumed as though it was a distribute bricks.
That means the volume is getting converted to distribute-disperse.
There are no tier xattrs too.
We need to support tier with disperse/EC volume as this is a usecase where cutomers would want to use a cold tier as disperse type with the hot tier as SSDs


Version-Release number of selected component (if applicable):
============================================================
3.7 upstream nightlies build http://download.gluster.org/pub/gluster/glusterfs/nightly/glusterfs/epel-6-x86_64/glusterfs-3.7dev-0.821.git0934432.autobuild//

root@interstellar glusterfs]# gluster --version
glusterfs 3.7dev built on Mar 28 2015 01:05:28
Repository revision: git://git.gluster.com/glusterfs.git
Copyright (c) 2006-2011 Gluster Inc. <http://www.gluster.com>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
You may redistribute copies of GlusterFS under the terms of the GNU General Public License.


Steps to Reproduce:
===================

1. Create a disperse volume and start it
   [root@interstellar ~]# gluster v create ec1 disperse-data 2 redundancy 1   transformers:/pavanbrick1/ec1/b1 interstellar:/pavanbrick1/ec1/b1 transformers:/pavanbrick1/ec1/rb1 force
volume create: ec1: success: please start the volume to access data
[root@interstellar ~]# gluster v start ec1
volume start: ec1: success
[root@interstellar ~]# gluster v status ec1
Status of volume: ec1
Gluster process                             TCP Port  RDMA Port  Online  Pid
------------------------------------------------------------------------------
Brick transformers:/pavanbrick1/ec1/b1      49160     0          Y       44215
Brick interstellar:/pavanbrick1/ec1/b1      49160     0          Y       40225
Brick transformers:/pavanbrick1/ec1/rb1     49161     0          Y       44235
NFS Server on localhost                     N/A       N/A        N       N/A  
NFS Server on 10.70.34.44                   N/A       N/A        N       N/A  
 
Task Status of Volume ec1
------------------------------------------------------------------------------
There are no active volume tasks

2.Now add a tier 
[root@interstellar ~]# gluster v attach-tier ec1 transformers:/pavanbrick2/ec1/hb1 interstellar:/pavanbrick2/ec1/hb1

3.check the vol info
[root@interstellar ~]# gluster v info ec1
 
Volume Name: ec1
Type: Distributed-Disperse
Volume ID: 1c47d8a3-f26f-4ef5-ad32-7da3462aaa61
Status: Started
Number of Bricks: 1 x (2 + 1) = 5
Transport-type: tcp
Bricks:
Brick1: interstellar:/pavanbrick2/ec1/hb1
Brick2: transformers:/pavanbrick2/ec1/hb1
Brick3: transformers:/pavanbrick1/ec1/b1
Brick4: interstellar:/pavanbrick1/ec1/b1
Brick5: transformers:/pavanbrick1/ec1/rb1



Expected results:
==================
support Tiering with EC properly.

Comment 2 Nag Pavan Chilakam 2015-03-31 07:12:49 UTC
[root@transformers glusterfs]# getfattr -d -e hex -m . /pavanbrick1/ec1/*
getfattr: Removing leading '/' from absolute path names
# file: pavanbrick1/ec1/b1
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.volume-id=0x1c47d8a3f26f4ef5ad327da3462aaa61

# file: pavanbrick1/ec1/rb1
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.volume-id=0x1c47d8a3f26f4ef5ad327da3462aaa61

[root@transformers glusterfs]# getfattr -d -e hex -m . /pavanbrick2/ec1/*
getfattr: Removing leading '/' from absolute path names
# file: pavanbrick2/ec1/hb1
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.glusterfs.volume-id=0x1c47d8a3f26f4ef5ad327da3462aaa61



[root@interstellar glusterfs]# getfattr -d -e hex -m . /pavanbrick1/ec1/*
getfattr: Removing leading '/' from absolute path names
# file: pavanbrick1/ec1/b1
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.gfid=0x00000000000000000000000000000001
trusted.glusterfs.volume-id=0x1c47d8a3f26f4ef5ad327da3462aaa61

[root@interstellar glusterfs]# getfattr -d -e hex -m . /pavanbrick2/ec1/*
getfattr: Removing leading '/' from absolute path names
# file: pavanbrick2/ec1/hb1
security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000
trusted.glusterfs.volume-id=0x1c47d8a3f26f4ef5ad327da3462aaa61

Comment 3 Dan Lambright 2015-04-01 22:49:43 UTC
This should be addressed in bug 1206517 .

Comment 4 Dan Lambright 2015-04-21 18:22:05 UTC
We no longer display "Distributed-Disperse" when a tier is attached. Fix 10054 made is such that the volume type is "tier". As this is the only problem referred to in this bug I am returning it. We will further change the volume info to separate out hot bricks from cold bricks but this is being tracked by 1206546.

Comment 5 Niels de Vos 2015-05-15 13:07:35 UTC
This change should not be in "ON_QA", the patch posted for this bug is only available in the master branch and not in a release yet. Moving back to MODIFIED until there is an beta release for the next GlusterFS version.

Comment 6 Joseph Elwin Fernandes 2016-02-14 03:58:23 UTC
This bug is solved in https://bugzilla.redhat.com/show_bug.cgi?id=1206517
And hence