Bug 887301 - Container listing of objects is sorted resulting is higher latency in response time
Container listing of objects is sorted resulting is higher latency in respons...
Product: GlusterFS
Classification: Community
Component: object-storage (Show other bugs)
x86_64 Linux
unspecified Severity high
: ---
: ---
Assigned To: Peter Portante
Depends On:
Blocks: 952693
  Show dependency treegraph
Reported: 2012-12-14 10:48 EST by Peter Portante
Modified: 2015-12-01 11:45 EST (History)
3 users (show)

See Also:
Fixed In Version: glusterfs-3.4.0
Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of:
Last Closed: 2013-07-24 13:29:12 EDT
Type: Bug
Regression: ---
Mount Type: ---
Documentation: ---
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---

Attachments (Terms of Use)

  None (edit)
Description Peter Portante 2012-12-14 10:48:04 EST
The OpenStack Swift REST API does not require the list of objects returned by a GET on a container to be sorted. The DiskDir object performs such a sort on the entire list of files in the directory, after they have been read, but before any filtering is applied. This is not necessary and for containers that contain lots and lots of objects this is a potential performance issue.
Comment 1 Vijay Bellur 2012-12-17 09:16:56 EST
CHANGE: http://review.gluster.org/4312 (object-storage: don't sort object list, not req'd) merged in master by Vijay Bellur (vbellur@redhat.com)
Comment 2 Peter Portante 2013-01-02 07:13:59 EST
Junaid, if you don't mind, I'll take this one. I have been doing some research on this. Even though the REST API for container listing of objects does not say it returns a sorted list of objects, the operation of marker parameter implies it.

So this change is really introducing a bug.

I have a set of changes that I am working on for the DiskDir module that will hopefully mitigate this by restoring the sort.
Comment 3 Junaid 2013-01-22 01:27:17 EST
Peter, can we move this bug to on_qa or are there any other patches that are in pipeline for this bug?
Comment 4 Peter Portante 2013-01-22 07:07:36 EST
There is more work to be done, not in the pipeline, though, to address this issue. I have started some of it, but put in on hold due to other issues that have come up.
Comment 5 Vijay Bellur 2013-02-11 21:01:10 EST
CHANGE: http://review.gluster.org/4360 (object-storage: Use the wrapper functions provided by fs_utils.py to make   system calls.) merged in master by Anand Avati (avati@redhat.com)
Comment 6 Vijay Bellur 2013-03-07 06:00:25 EST
CHANGE: http://review.gluster.org/4394 (object-storage: Fixing the errors and warnings in unittest.) merged in master by Vijay Bellur (vbellur@redhat.com)

Note You need to log in before you can comment on or make changes to this bug.