Bug 1265532

Description of problem:
=======================
I created a tiered volume and enabled quota on it and set hardlimit of 10GB.
I left it to the default soft limit of 80%.
I filed the volume till the 10GB limit and was getting quota exceeded error on new creates as expected.
I then searched in the brick messages for softlimit error and it did display as below:
[root@zod bricks]# cat *dubai*|grep "soft limit"
[2015-09-23 06:40:14.647633] A [MSGID: 120004] [quota.c:4972:quota_log_usage] 0-dubai-quota: Usage is above soft limit: 9.5GB used by /
[2015-09-23 06:39:48.013035] A [MSGID: 120004] [quota.c:4972:quota_log_usage] 0-dubai-quota: Usage is above soft limit: 9.5GB used by /
[2015-09-23 06:40:32.544166] A [MSGID: 120004] [quota.c:4972:quota_log_usage] 0-dubai-quota: Usage is above soft limit: 9.5GB used by /
[2015-09-23 06:39:06.008352] A [MSGID: 120004] [quota.c:4972:quota_log_usage] 0-dubai-quota: Usage is above soft limit: 8.4GB used by /
[2015-09-23 06:39:06.008846] A [MSGID: 120004] [quota.c:4972:quota_log_usage] 0-dubai-quota: Usage is above soft limit: 8.4GB used by /
[2015-09-23 06:39:23.190060] A [MSGID: 120004] [quota.c:4972:quota_log_usage] 0-dubai-quota: Usage is above soft limit: 8.8GB used by /

I now increased the hardlimit to 20GB(and hence softlimit to 16GB), and the "gluster v quota list" showed the updated softlimit and hardlimit values.

I then filled the volume till hardlimit was hit , and got quota exceeded error as expected, but there was no softlimit error thrown again once i had reached 16GB.

I tried this multilple times, but didnt see any new softlimit errors


Version-Release number of selected component (if applicable):
================================================================
root@zod ~]# rpm -qa|grep gluster
glusterfs-3.7.4-0.43.gitf139283.el7.centos.x86_64
glusterfs-fuse-3.7.4-0.43.gitf139283.el7.centos.x86_64
glusterfs-debuginfo-3.7.4-0.33.git1d02d4b.el7.centos.x86_64
glusterfs-api-3.7.4-0.43.gitf139283.el7.centos.x86_64
glusterfs-client-xlators-3.7.4-0.43.gitf139283.el7.centos.x86_64
glusterfs-server-3.7.4-0.43.gitf139283.el7.centos.x86_64
glusterfs-cli-3.7.4-0.43.gitf139283.el7.centos.x86_64
glusterfs-libs-3.7.4-0.43.gitf139283.el7.centos.x86_64
[root@zod ~]# gluster --version
glusterfs 3.7.4 built on Sep 19 2015 01:30:43
Repository revision: git://git.gluster.com/glusterfs.git
Copyright (c) 2006-2011 Gluster Inc. <http://www.gluster.com>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
You may redistribute copies of GlusterFS under the terms of the GNU General Public License.




Steps to Reproduce:
===================
1.create and start a  tier volume
2.enabled quota and set hardlimit to say 10GB(left it to the default softlimit of 80% ie 8GB)
3.now fill 10GB of data and see brick logs, it would displayed softlimit error
4. Now fill the whole hardlimit and you will see quota exceeded error on mount
5.Now expand quota limit to  20GB (that means softlimit will be 16GB-80%)
6. Now try to fill 20GB 


You won't see any more softlimit errros but hardlimits work well.
Infact the cli of quota lists too is getting updated correctly but no new brick messages on softlimit hit