Bug 764339 (GLUSTER-2607) - Fileop fails when quota is enabled
Summary: Fileop fails when quota is enabled
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: GLUSTER-2607
Product: GlusterFS
Classification: Community
Component: quota
Version: mainline
Hardware: x86_64
OS: Linux
urgent
high
Target Milestone: ---
Assignee: Raghavendra G
QA Contact:
URL:
Whiteboard:
: GLUSTER-2599 (view as bug list)
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2011-03-29 18:11 UTC by Vijay Bellur
Modified: 2013-12-03 18:39 UTC (History)
1 user (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed:
Regression: RTNR
Mount Type: fuse
Documentation: DNR
CRM:
Verified Versions:


Attachments (Terms of Use)

Description Vijay Bellur 2011-03-29 18:11:17 UTC
When quota is enabled with no other options set, fileop, iozone etc. fail

Volume Name: dr
Type: Distributed-Replicate
Status: Started
Number of Bricks: 2 x 2 = 4
Transport-type: tcp
Bricks:
Brick1: deepthought:/data/export/dr1
Brick2: deepthought:/data/export/dr2
Brick3: deepthought:/data/export/dr3
Brick4: deepthought:/data/export/dr4
Options Reconfigured:
features.quota: on

Comment 1 Raghavendra G 2011-04-01 00:44:13 UTC
*** Bug 2599 has been marked as a duplicate of this bug. ***

Comment 2 Saurabh 2011-04-04 03:51:46 UTC
This bug is still seen over nfs mount, can we have some ETA for this bug?

Comment 3 Vijay Bellur 2011-04-04 08:20:44 UTC
(In reply to comment #2)
> This bug is still seen over nfs mount, can we have some ETA for this bug?

Can you please provide the exact fileop command that you used?

Thanks,
Vijay

Comment 4 Saurabh 2011-04-05 03:04:49 UTC
bug #764331 is duplicated to this bug, hence I updated this bug.

Well, I used dd over nfs mount. 

[root@centos-qa-client-1 ~]# mount | grep nfs
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
10.1.10.199:/mnt/soho_storage/samba/shares/opt on /opt type nfs (rw,addr=10.1.10.199)
10.1.12.134:/dist1 on /mnt/nfs-test type nfs (rw,nfsvers=3,nolock,addr=10.1.12.134)
[root@centos-qa-client-1 ~]# cd /mnt/nfs-test/
l[root@centos-qa-client-1 nfs-test]# ls
d1  d2  d3  test
[root@centos-qa-client-1 nfs-test]# dd if=/dev/zero of=f.1 bs=1K count=1
dd: opening `f.1': Unknown error 526
[root@centos-qa-client-1 nfs-test]#

Comment 5 Saurabh 2011-04-05 09:24:46 UTC
Hey, on latest qa release this bug still can be seen on dist-rep volumes but not on distribute volumes

[root@centos-qa-client-1 d4]# mount | grep nfs
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
10.1.10.199:/mnt/soho_storage/samba/shares/opt on /opt type nfs (rw,addr=10.1.10.199)
10.1.12.134:/rep1 on /mnt/nfs-test type nfs (rw,nfsvers=3,nolock,addr=10.1.12.134)
10.1.12.134:/dist2 on /mnt/nfs-dir type nfs (rw,nfsvers=3,nolock,addr=10.1.12.134)



[root@centos-qa-client-1 ~]# cd /mnt/nfs-dir
[root@centos-qa-client-1 nfs-dir]# ls
d1  d2  d3  d4  test
[root@centos-qa-client-1 nfs-dir]# cd d4
[root@centos-qa-client-1 d4]# ls
[root@centos-qa-client-1 d4]# dd if=/dev/zero of=f.n bs=10K count=1
1+0 records in
1+0 records out
10240 bytes (10 kB) copied, 0.089926 seconds, 114 kB/s

[root@centos-qa-client-2 sbin]# ./gluster volume info dist2

Volume Name: dist2
Type: Distribute
Status: Started
Number of Bricks: 2
Transport-type: tcp
Bricks:
Brick1: 10.1.12.134:/mnt/dist2
Brick2: 10.1.12.135:/mnt/dist2
Options Reconfigured:
features.quota: on
features.limit-usage: /:3MB,/d1:1MB,/d2:1MB



##############################################################


[root@centos-qa-client-1 nfs-test]# cd d1
[root@centos-qa-client-1 d1]# dd if=/dev/zero of=f.n bs=10K count=1
dd: opening `f.n': Unknown error 526


[root@centos-qa-client-2 sbin]# ./gluster volume info rep1

Volume Name: rep1
Type: Distributed-Replicate
Status: Started
Number of Bricks: 2 x 3 = 6
Transport-type: tcp
Bricks:
Brick1: 10.1.12.134:/mnt/rep1
Brick2: 10.1.12.135:/rep1
Brick3: 10.1.12.135:/mnt/rep-rep1
Brick4: 10.1.12.134:/rep2
Brick5: 10.1.12.135:/mnt/rep2
Brick6: 10.1.12.135:/mnt/rep-rep2
Options Reconfigured:
features.limit-usage: /:4MB,/d1:1MB,/d2:1MB
features.quota: on
[root@centos-qa-client-2 sbin]#

Comment 6 Saurabh 2011-04-05 09:45:53 UTC
Not seen on stripped volume also.

Comment 7 Raghavendra G 2011-04-06 05:34:26 UTC
The bug is not consistently reproducible. Hence deferring work on it till we hit the bug again.

Comment 8 Vijay Bellur 2011-04-07 15:40:04 UTC
PATCH: http://patches.gluster.com/patch/6701 in master (features/marker: Check for NULL before dereferencing pointers stored in local.)

Comment 9 Saurabh 2011-04-12 11:07:23 UTC
[root@ip-10-150-183-65 ~]# ./gluster/inst/sbin/gluster volume info 

Volume Name: dist-rep1
Type: Distributed-Replicate
Status: Started
Number of Bricks: 2 x 2 = 4
Transport-type: tcp
Bricks:
Brick1: ip-10-150-99-196.ap-northeast-1.compute.internal:/mnt/dist-rep1
Brick2: ip-10-150-91-14.ap-northeast-1.compute.internal:/mnt/dist-rep-rep1
Brick3: ip-10-150-101-116.ap-northeast-1.compute.internal:/mnt/dist-rep1
Brick4: ip-10-150-183-65.ap-northeast-1.compute.internal:/mnt/dist-rep-rep1
Options Reconfigured:
features.quota: on
#####################################################################

Started run.sh on the client side for both nfs and glusterfs mount,
and tests-failed file does not mention failures,

[root@ip-10-150-141-88 gluster-test]# cat /mnt/logs/tests_failed
kernel compile failed
dbench failed
syscallbench failed
Total 14 tests were successful
kernel compile failed
dbench failed
syscallbench failed
Total 14 tests were successful
[root@ip-10-150-141-88 gluster-test]# 

Infact the failures mentioned here are because of the config as some files were not found.


even Iozone is also a pass over fuse mount

       524288     256   20527   29491    48170    84086   58009   29987   54619    28391    68486    19163    26852   83229    82711
          524288     512   33906   21926    86644    82360   38117   28548   39585    35890    44353    23618    17588   81525    83580
          524288    1024   24257   34110    86173    90805   50710   25937   57258    45534    54017    21628    23919   67677    82606
          524288    2048   19039   26895    79736    81609   61188   25985   62095    23385    58896    28027    24885   76821    76430
          524288    4096   27163   28456    77774    83294   72134   25462   74834    21200    69014    28583    31650   82611    77428
          524288    8192   28176   29449    73577    79540   77645   28518   71971    24841    84201    29710    27235   84012    81246
          524288   16384   20239   25823    79593    86666   85466   31103   80795    31753    84080    27961    33827   86086    80809

iozone test complete.

Comment 10 Saurabh 2011-04-12 13:46:17 UTC
129149   54552  3260397
          524288     128 1379207   75993    49191  2297595 3286083   33094   28420  2802971  2962597    29763  1013831   52420  3115475
          524288     256 1146187 1127891    50136  2244084 2386999 1377319   35302  4283749  3182438   967727    24449   53803  2262633
          524288     512 1144396   88883    54692  2309588 3363666 1224151   43204  4425192  2406976   866733    23224   52346  2307797
          524288    1024 1241021 1131765    56069  2162003 2363903 1352439   43516  4467654    40284   803565    64539   49171  2194003
          524288    2048   60234   35167    54695  1961377 2044190   23044   39905  1778700  1974681   749097    37121   50436  1948772
          524288    4096 1064772 1009181    53496  1394364 1736863 1123986   53098  1274192    58537    65230   768077   50788  1677355
          524288    8192 1047197  934011    50862  1400865 1678436 1044124   50853  1515156    53598    28682    59866   47988  1404411
          524288   16384  914687  832634    53860  1653085 1434498  984561   53310   378996  1440126   763768   703743   53435  1407190

iozone test complete.


Passed Iozone test nfs mount

ip-10-150-183-65.ap-northeast-1.compute.internal:/dist-rep1 on /mnt/nfs-test type nfs (rw,nfsvers=3,nolock,addr=10.150.183.65)


Note You need to log in before you can comment on or make changes to this bug.