Description of problem:

  quota information mismatch which glusterfs on zfs environment

Version-Release number of selected component (if applicable):

  glusterfs 3.9dev of master branch


How reproducible:


Steps to Reproduce:

1. disk Information
  $ ls -al /dev/disk/by-path/ | grep sd[b-g] | grep -v "part" | awk '{print $8'}
  pci-0000:00:10.0-scsi-0:0:1:0
  pci-0000:00:10.0-scsi-0:0:2:0
  pci-0000:00:10.0-scsi-0:0:3:0
  pci-0000:00:10.0-scsi-0:0:4:0
  pci-0000:00:10.0-scsi-0:0:5:0
  pci-0000:00:10.0-scsi-0:0:6:0

2. zfs pool & volume create
  $ zpool create -f tpool -o ashift=12 pci-0000:00:10.0-scsi-0:0:1:0 pci-0000:00:10.0-scsi-0:0:2:0 pci-0000:00:10.0-scsi-0:0:3:0
  $ zpool add -f tpool cache pci-0000:00:10.0-scsi-0:0:4:0
  $ zpool add -f tpool log pci-0000:00:10.0-scsi-0:0:5:0 pci-0000:00:10.0-scsi-0:0:6:0
  $ zfs set acltype=posixacl tpool
  $ zfs create tpool/tvol1
  $ zfs set xattr=sa tpool
  $ zfs set xattr=sa tpool/tvol1

3. gluster volume create
  $ gluster volume create tvol1 <server ip address>:/tpool/tvol1 force
  $ gluster volume start tvol1
  $ gluster volume quota tvol1 enable
  $ gluster volume quota tvol1 limit-usage / 1TB

4. gluster volume mount
  $ mount -t glusterfs <server ip address>:/tvol1 /mnt

5. file create: using the dd command
  $ dd if=/dev/zero of=/mnt/dummy bs=1M count=1
  1+0 records in
  1+0 records out
  1048576 bytes (1.0 MB) copied, 0.0131786 s, 79.6 MB/s

  $ df
  Filesystem         1K-blocks    Used  Available Use% Mounted on
  <server ip addr>:/tvol1 1073741824       0 1073741824   0% /mnt

6. quota information
  $ gluster volume quota tvol1 list
                  Path                   Hard-limit  Soft-limit      Used  Available  Soft-limit exceeded? Hard-limit exceeded?
-------------------------------------------------------------------------------------------------------------------------------
/                                          1.0TB     80%(819.2GB) 512Bytes 1024.0GB              No                   No



Actual results:

                  Path                   Hard-limit  Soft-limit      Used  Available  Soft-limit exceeded? Hard-limit exceeded?
-------------------------------------------------------------------------------------------------------------------------------
/                                          1.0TB     80%(819.2GB) 512Bytes 1024.0GB              No                   No


Expected results:

                  Path                   Hard-limit  Soft-limit      Used  Available  Soft-limit exceeded? Hard-limit exceeded?
-------------------------------------------------------------------------------------------------------------------------------
/                                          1.0TB     80%(819.2GB)    1.0MB 1024.0GB              No                   No

Additional info:

1. os & kernel version:

  $ cat /etc/issue
  CentOS release 6.8 (Final)
  Kernel \r on an \m

  $ uname -r
  2.6.32-642.el6.x86_64

2. zfs version:

  $ dmesg | grep ZFS
  ZFS: Loaded module v0.6.5.7-1, ZFS pool version 5000, ZFS filesystem version 5