Bug 904629 - Concurrent requests of large objects (GET/PUT) can be starved by small object requests
Summary: Concurrent requests of large objects (GET/PUT) can be starved by small object...
Keywords:
Status: ASSIGNED
Alias: None
Product: Gluster-Swift
Classification: Community
Component: Proxy-server
Version: 0.1
Hardware: x86_64
OS: Linux
medium
medium
Target Milestone: ---
Assignee: Nobody
QA Contact:
URL:
Whiteboard:
Depends On:
Blocks: 903396 978061
TreeView+ depends on / blocked
 
Reported: 2013-01-26 15:44 UTC by Peter Portante
Modified: 2023-01-31 23:40 UTC (History)
1 user (show)

Fixed In Version:
Clone Of:
Environment:
Last Closed:
Embargoed:


Attachments (Terms of Use)
Timing data for transfers for concurrent clients. (334.90 KB, application/vnd.oasis.opendocument.spreadsheet)
2013-01-26 15:44 UTC, Peter Portante
no flags Details

Description Peter Portante 2013-01-26 15:44:05 UTC
Created attachment 688070 [details]
Timing data for transfers for concurrent clients.

The default *_chunk_size parameters for proxy and object servers is 64 KB. Recent testing seems to favor small requests with that setting. However, when that value is raise to around 2.6MB, large objects transfer at a more reasonable rate, while small objects begin being penalized.

This is an indication that potential blocking file system operations on one request are starving other requests. When the setting is low, 64 KB, the small requests are serviced at speed, but because of the shear number of them, the large requests are not given the bandwidth necessary for speedy transfers. When the settings are higher, 2.6 MB, large transfers potentially block filling chuck_size'd buffers causing small requests to be starved.

Comment 1 Anand Avati 2013-04-08 02:27:11 UTC
REVIEW: http://review.gluster.org/4789 (object-storage: provide more common cfg defaults) posted (#1) for review on master by Mohammed Junaid (junaid)

Comment 2 Anand Avati 2013-04-12 07:07:21 UTC
REVIEW: http://review.gluster.org/4789 (object-storage: provide more common cfg defaults) posted (#2) for review on master by Mohammed Junaid (junaid)

Comment 3 Anand Avati 2013-04-12 07:08:34 UTC
REVIEW: http://review.gluster.org/4808 (object-storage: Renamed 1.conf files to there corresponding server.conf.) posted (#1) for review on master by Mohammed Junaid (junaid)

Comment 4 Anand Avati 2013-04-12 20:50:14 UTC
COMMIT: http://review.gluster.org/4789 committed in master by Anand Avati (avati) 
------
commit 6d6205ede5e90a919d082b4413055d684114253a
Author: Mohammed Junaid <junaid>
Date:   Fri Apr 12 06:41:29 2013 +0530

    object-storage: provide more common cfg defaults
    
    Provide more common configuration defaults, as seen and recommended across
    many large customer installations, as well as provide some guidance on how to
    set the parameters.
    
    See BZ 904629 (https://bugzilla.redhat.com/show_bug.cgi?id=904629).
    
    Change-Id: Id9f20aafd75f2a0b589c67654dce87534bf80c33
    BUG: 904629
    Signed-off-by: Mohammed Junaid <junaid>
    Reviewed-on: http://review.gluster.org/4789
    Reviewed-by: Kaleb KEITHLEY <kkeithle>
    Tested-by: Gluster Build System <jenkins.com>
    Reviewed-by: Anand Avati <avati>

Comment 5 Anand Avati 2013-04-19 18:17:15 UTC
REVIEW: http://review.gluster.org/4808 (object-storage: Renamed 1.conf files to there corresponding server-name.conf.) posted (#2) for review on master by Mohammed Junaid (junaid)


Note You need to log in before you can comment on or make changes to this bug.