Description of problem: Quota list is not working on tiered volume. after detaching the tier then it shows the quota limit. Version-Release number of selected component (if applicable): [root@rhsqa14-vm1 ~]# glusterfs --version glusterfs 3.7.1 built on Jun 9 2015 02:31:54 Repository revision: git://git.gluster.com/glusterfs.git Copyright (c) 2006-2013 Red Hat, Inc. <http://www.redhat.com/> GlusterFS comes with ABSOLUTELY NO WARRANTY. It is licensed to you under your choice of the GNU Lesser General Public License, version 3 or any later version (LGPLv3 or later), or the GNU General Public License, version 2 (GPLv2), in all cases as published by the Free Software Foundation. [root@rhsqa14-vm1 ~]# rpm -qa | grep gluster glusterfs-3.7.1-1.el6rhs.x86_64 glusterfs-cli-3.7.1-1.el6rhs.x86_64 glusterfs-libs-3.7.1-1.el6rhs.x86_64 glusterfs-client-xlators-3.7.1-1.el6rhs.x86_64 glusterfs-fuse-3.7.1-1.el6rhs.x86_64 glusterfs-server-3.7.1-1.el6rhs.x86_64 glusterfs-api-3.7.1-1.el6rhs.x86_64 [root@rhsqa14-vm1 ~]# How reproducible: easily Steps to Reproduce: 1.create a normal distrep volume. 2.apply quota settings. 3.attach tier and check quota list on that volume. Actual results: quota list is not showing anything Additional info: [root@rhsqa14-vm1 ~]# gluster v info Tim Volume Name: Tim Type: Tier Volume ID: ee4e47a7-a067-4d4b-869b-32d60eefb0a5 Status: Started Number of Bricks: 6 Transport-type: tcp Hot Tier : Hot Tier Type : Replicate Number of Bricks: 1 x 2 = 2 Brick1: 10.70.47.163:/rhs/brick3/k0 Brick2: 10.70.47.165:/rhs/brick3/k0 Cold Tier: Cold Tier Type : Distributed-Replicate Number of Bricks: 2 x 2 = 4 Brick3: 10.70.47.165:/rhs/brick1/k0 Brick4: 10.70.47.163:/rhs/brick1/k0 Brick5: 10.70.47.165:/rhs/brick2/k0 Brick6: 10.70.47.163:/rhs/brick2/k0 Options Reconfigured: features.quota-deem-statfs: on features.uss: enable features.inode-quota: on features.quota: on cluster.min-free-disk: 10 performance.readdir-ahead: on [root@rhsqa14-vm1 ~]# [root@rhsqa14-vm1 ~]# gluster v quota Tim disable Disabling quota will delete all the quota configuration. Do you want to continue? (y/n) y volume quota : success [root@rhsqa14-vm1 ~]# [root@rhsqa14-vm1 ~]# [root@rhsqa14-vm1 ~]# gluster v quota Tim enable volume quota : success [root@rhsqa14-vm1 ~]# gluster v quota Tim list quota: No quota configured on volume Tim [root@rhsqa14-vm1 ~]# [root@rhsqa14-vm1 ~]# [root@rhsqa14-vm1 ~]# gluster v quota Tim limit-usage / 20MB volume quota : success [root@rhsqa14-vm1 ~]# [root@rhsqa14-vm1 ~]# gluster v quota Tim list Path Hard-limit Soft-limit Used Available Soft-limit exceeded? Hard-limit exceeded? --------------------------------------------------------------------------------------------------------------------------- [root@rhsqa14-vm1 ~]# gluster v quota test list Path Hard-limit Soft-limit Used Available Soft-limit exceeded? Hard-limit exceeded? --------------------------------------------------------------------------------------------------------------------------- [root@rhsqa14-vm1 ~]# [root@rhsqa14-vm1 ~]#
quota i snot working on tiered volume also. 1. create dist vol, 2. attach tier. 3. apply quota settings to tiered vol. 4. check quota list . [root@rhsqa14-vm1 ~]# gluster v create mix 10.70.47.165:/rhs/brick3/h0 10.70.47.163:/rhs/brick3/h0 volume create: mix: success: please start the volume to access data [root@rhsqa14-vm1 ~]# gluster v start mix volume start: mix: success [root@rhsqa14-vm1 ~]# gluster v info mix Volume Name: mix Type: Distribute Volume ID: 0f1a01aa-9b1a-4cd5-bc9c-64b14630f264 Status: Started Number of Bricks: 2 Transport-type: tcp Bricks: Brick1: 10.70.47.165:/rhs/brick3/h0 Brick2: 10.70.47.163:/rhs/brick3/h0 Options Reconfigured: performance.readdir-ahead: on [root@rhsqa14-vm1 ~]# [root@rhsqa14-vm1 ~]# [root@rhsqa14-vm1 ~]# gluster v status mix Status of volume: mix Gluster process TCP Port RDMA Port Online Pid ------------------------------------------------------------------------------ Brick 10.70.47.165:/rhs/brick3/h0 49176 0 Y 15439 Brick 10.70.47.163:/rhs/brick3/h0 49176 0 Y 14757 NFS Server on localhost 2049 0 Y 15459 NFS Server on 10.70.47.159 2049 0 Y 11951 NFS Server on 10.70.46.2 2049 0 Y 1416 NFS Server on 10.70.47.163 2049 0 Y 14781 Task Status of Volume mix ------------------------------------------------------------------------------ There are no active volume tasks [root@rhsqa14-vm1 ~]# gluster v attach-tier mix 10.70.47.165:/rhs/brick4/h0 10.70.47.163:/rhs/brick4/h0 Attach tier is recommended only for testing purposes in this release. Do you want to continue? (y/n) y volume attach-tier: success volume rebalance: mix: success: Rebalance on mix has been started successfully. Use rebalance status command to check status of the rebalance process. ID: e5858e08-2ccc-4176-9b2d-bf1419251323 [root@rhsqa14-vm1 ~]# [root@rhsqa14-vm1 ~]# [root@rhsqa14-vm1 ~]# gluster v info mix Volume Name: mix Type: Tier Volume ID: 0f1a01aa-9b1a-4cd5-bc9c-64b14630f264 Status: Started Number of Bricks: 4 Transport-type: tcp Hot Tier : Hot Tier Type : Distribute Number of Bricks: 2 Brick1: 10.70.47.163:/rhs/brick4/h0 Brick2: 10.70.47.165:/rhs/brick4/h0 Cold Tier: Cold Tier Type : Distribute Number of Bricks: 2 Brick3: 10.70.47.165:/rhs/brick3/h0 Brick4: 10.70.47.163:/rhs/brick3/h0 Options Reconfigured: performance.readdir-ahead: on [root@rhsqa14-vm1 ~]# ./options.sh mix volume set: success volume quota : success volume set: success volume quota : success volume set: success [root@rhsqa14-vm1 ~]# gluster v quota mix list Path Hard-limit Soft-limit Used Available Soft-limit exceeded? Hard-limit exceeded? --------------------------------------------------------------------------------------------------------------------------- [root@rhsqa14-vm1 ~]# [root@rhsqa14-vm1 ~]# [root@rhsqa14-vm1 ~]# gluster v status mix Status of volume: mix Gluster process TCP Port RDMA Port Online Pid ------------------------------------------------------------------------------ Hot Bricks: Brick 10.70.47.163:/rhs/brick4/h0 49177 0 Y 14853 Brick 10.70.47.165:/rhs/brick4/h0 49177 0 Y 15541 Cold Bricks: Brick 10.70.47.165:/rhs/brick3/h0 49176 0 Y 15439 Brick 10.70.47.163:/rhs/brick3/h0 49176 0 Y 14757 Snapshot Daemon on localhost 49178 0 Y 15792 NFS Server on localhost 2049 0 Y 15800 Quota Daemon on localhost N/A N/A Y 15700 Snapshot Daemon on 10.70.47.159 N/A N/A N N/A NFS Server on 10.70.47.159 2049 0 Y 12163 Quota Daemon on 10.70.47.159 N/A N/A Y 12087 Snapshot Daemon on 10.70.47.163 49178 0 Y 15071 NFS Server on 10.70.47.163 2049 0 Y 15079 Quota Daemon on 10.70.47.163 N/A N/A Y 14993 Snapshot Daemon on 10.70.46.2 N/A N/A N N/A NFS Server on 10.70.46.2 2049 0 Y 1643 Quota Daemon on 10.70.46.2 N/A N/A Y 1561 Task Status of Volume mix ------------------------------------------------------------------------------ Task : Rebalance ID : e5858e08-2ccc-4176-9b2d-bf1419251323 Status : in progress [root@rhsqa14-vm1 ~]# [root@rhsqa14-vm1 ~]# gluster v rebalance mix status Node Rebalanced-files size scanned failures skipped status run time in s --------- ----------- ----------- ----------- ----------- ----------- ------------ ----------- localhost 0 0Bytes 0 0 0 in progress 200 10.70.47.163 0 0Bytes 0 0 0 in progress 200 volume rebalance: mix: success: [root@rhsqa14-vm1 ~]#
i detached the same tiered volume and commited the detach. then i see that quota is applied on only cold tier instead of the whole tiered volume. root@rhsqa14-vm1 ~]# gluster v info mix Volume Name: mix Type: Tier Volume ID: 0f1a01aa-9b1a-4cd5-bc9c-64b14630f264 Status: Started Number of Bricks: 4 Transport-type: tcp Hot Tier : Hot Tier Type : Distribute Number of Bricks: 2 Brick1: 10.70.47.163:/rhs/brick4/h0 Brick2: 10.70.47.165:/rhs/brick4/h0 Cold Tier: Cold Tier Type : Distribute Number of Bricks: 2 Brick3: 10.70.47.165:/rhs/brick3/h0 Brick4: 10.70.47.163:/rhs/brick3/h0 Options Reconfigured: features.quota-deem-statfs: on features.uss: enable features.inode-quota: on features.quota: on cluster.min-free-disk: 10 performance.readdir-ahead: on [root@rhsqa14-vm1 ~]# gluster v detach-tier mix start volume detach-tier start: success ID: 5f08c911-0007-4fd5-b88f-f8ba6b3aefa2 [root@rhsqa14-vm1 ~]# [root@rhsqa14-vm1 ~]# gluster v detach-tier mix status Node Rebalanced-files size scanned failures skipped status run time in s --------- ----------- ----------- ----------- ----------- ----------- ------------ ----------- localhost 0 0Bytes 0 0 0 completed 0 10.70.47.163 0 0Bytes 0 0 0 completed 0 [root@rhsqa14-vm1 ~]# gluster v detach-tier mix commit volume detach-tier commit: success Check the detached bricks to ensure all files are migrated. If files with data are found on the brick path, copy them via a gluster mount point before re-purposing the removed brick. [root@rhsqa14-vm1 ~]# [root@rhsqa14-vm1 ~]# gluster v info mix Volume Name: mix Type: Distribute Volume ID: 0f1a01aa-9b1a-4cd5-bc9c-64b14630f264 Status: Started Number of Bricks: 2 Transport-type: tcp Bricks: Brick1: 10.70.47.165:/rhs/brick3/h0 Brick2: 10.70.47.163:/rhs/brick3/h0 Options Reconfigured: features.quota-deem-statfs: on features.uss: enable features.inode-quota: on features.quota: on cluster.min-free-disk: 10 performance.readdir-ahead: on [root@rhsqa14-vm1 ~]# gluster v quota mix list Path Hard-limit Soft-limit Used Available Soft-limit exceeded? Hard-limit exceeded? --------------------------------------------------------------------------------------------------------------------------- / 20.0MB 80% 0Bytes 20.0MB No No [root@rhsqa14-vm1 ~]#
upstream patch : http://review.gluster.org/#/c/11431/
verified on 3.7.5-5 and it works. [root@transformers ~]# gluster v quota vol1 list quota command failed : Quota is disabled, please enable quota [root@transformers ~]# gluster v quota vol1 enable volume quota : success [root@transformers ~]# gluster v quota vol1 list quota: No quota configured on volume vol1 [root@transformers ~]# gluster v quota vol1 limit-usage / 1TB volume quota : success [root@transformers ~]# gluster v quota vol1 list Path Hard-limit Soft-limit Used Available Soft-limit exceeded? Hard-limit exceeded? ------------------------------------------------------------------------------------------------------------------------------- / 1.0TB 80%(819.2GB) 5.6MB 1024.0GB No No [root@transformers ~]# [root@interstellar ~]# gluster v quota vol2 list Path Hard-limit Soft-limit Used Available Soft-limit exceeded? Hard-limit exceeded? ------------------------------------------------------------------------------------------------------------------------------- / 1.0TB 80%(819.2GB) 194.6GB 829.4GB No No [root@interstellar ~]# [root@interstellar ~]# gluster v quota vol2 disable Disabling quota will delete all the quota configuration. Do you want to continue? (y/n) y volume quota : success [root@interstellar ~]# gluster v quota vol2 list quota command failed : Quota is disabled, please enable quota [root@interstellar ~]#
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://rhn.redhat.com/errata/RHBA-2016-0193.html