Bug 816140 - Performance: du takes a _lot_ of time to complete
Performance: du takes a _lot_ of time to complete
Status: CLOSED CURRENTRELEASE
Product: GlusterFS
Classification: Community
Component: core (Show other bugs)
pre-release
Unspecified Unspecified
medium Severity medium
: ---
: ---
Assigned To: Vijay Bellur
Sachidananda Urs
:
Depends On:
Blocks:
  Show dependency treegraph
 
Reported: 2012-04-25 06:40 EDT by Sachidananda Urs
Modified: 2014-04-17 07:38 EDT (History)
4 users (show)

See Also:
Fixed In Version: glusterfs-3.5.0
Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of:
Environment:
Last Closed: 2014-04-17 07:38:42 EDT
Type: Bug
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---


Attachments (Terms of Use)

  None (edit)
Description Sachidananda Urs 2012-04-25 06:40:57 EDT
Description of problem:

[root@gqac009 nfs-3]# time find pax -type d | wc -l ; time find pax | wc -l
141129

real 524m23.144s
user 0m4.781s
sys 0m39.305s
2215227

real 435m9.818s
user 0m6.625s
sys 0m44.162s
[root@gqac009 nfs-3]#

===========================
  
[root@gqac009 pax]# time du -sh *
64K home
32K lost+found
41G mnt
23M selinux

real 525m1.208s
user 0m3.941s
sys 0m48.601s
[root@gqac009 pax]#


Steps to Reproduce:
run:

/mnt/pax# pax -v -r -w / .

Allow it to run overnight or for a couple of days, this will recursively copy /mnt onto /mnt/pax. Make sure you keep a few GB of data on /mnt (assuming GlusterFS is mounted on /mnt) which is enough to create quite a depth of directory hierarchy.

Setup is a four node distribute on NFS.
Comment 1 Vijay Bellur 2012-05-29 06:09:30 EDT
Deferring this to post RC. Patch available in upstream but a careful evaluation is necessary before that can be backported to release-3.3
Comment 2 Niels de Vos 2014-04-17 07:38:42 EDT
This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.5.0, please reopen this bug report.

glusterfs-3.5.0 has been announced on the Gluster Developers mailinglist [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution.

[1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/6137
[2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user

Note You need to log in before you can comment on or make changes to this bug.