Bug 887301 - Container listing of objects is sorted resulting is higher latency in response time
Summary: Container listing of objects is sorted resulting is higher latency in respons...
Alias: None
Product: GlusterFS
Classification: Community
Component: object-storage
Version: pre-release
Hardware: x86_64
OS: Linux
Target Milestone: ---
Assignee: Peter Portante
QA Contact:
Depends On:
Blocks: 952693
TreeView+ depends on / blocked
Reported: 2012-12-14 15:48 UTC by Peter Portante
Modified: 2015-12-01 16:45 UTC (History)
3 users (show)

Fixed In Version: glusterfs-3.4.0
Doc Type: Bug Fix
Doc Text:
Clone Of:
Last Closed: 2013-07-24 17:29:12 UTC
Regression: ---
Mount Type: ---
Documentation: ---
Verified Versions:

Attachments (Terms of Use)

Description Peter Portante 2012-12-14 15:48:04 UTC
The OpenStack Swift REST API does not require the list of objects returned by a GET on a container to be sorted. The DiskDir object performs such a sort on the entire list of files in the directory, after they have been read, but before any filtering is applied. This is not necessary and for containers that contain lots and lots of objects this is a potential performance issue.

Comment 1 Vijay Bellur 2012-12-17 14:16:56 UTC
CHANGE: http://review.gluster.org/4312 (object-storage: don't sort object list, not req'd) merged in master by Vijay Bellur (vbellur@redhat.com)

Comment 2 Peter Portante 2013-01-02 12:13:59 UTC
Junaid, if you don't mind, I'll take this one. I have been doing some research on this. Even though the REST API for container listing of objects does not say it returns a sorted list of objects, the operation of marker parameter implies it.

So this change is really introducing a bug.

I have a set of changes that I am working on for the DiskDir module that will hopefully mitigate this by restoring the sort.

Comment 3 Junaid 2013-01-22 06:27:17 UTC
Peter, can we move this bug to on_qa or are there any other patches that are in pipeline for this bug?

Comment 4 Peter Portante 2013-01-22 12:07:36 UTC
There is more work to be done, not in the pipeline, though, to address this issue. I have started some of it, but put in on hold due to other issues that have come up.

Comment 5 Vijay Bellur 2013-02-12 02:01:10 UTC
CHANGE: http://review.gluster.org/4360 (object-storage: Use the wrapper functions provided by fs_utils.py to make   system calls.) merged in master by Anand Avati (avati@redhat.com)

Comment 6 Vijay Bellur 2013-03-07 11:00:25 UTC
CHANGE: http://review.gluster.org/4394 (object-storage: Fixing the errors and warnings in unittest.) merged in master by Vijay Bellur (vbellur@redhat.com)

Note You need to log in before you can comment on or make changes to this bug.