Bug 1400924 - [RFE] Rsync flags for performance improvements
Summary: [RFE] Rsync flags for performance improvements
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: GlusterFS
Classification: Community
Component: geo-replication
Version: mainline
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
Assignee: Aravinda VK
QA Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2016-12-02 10:23 UTC by Aravinda VK
Modified: 2017-10-26 14:36 UTC (History)
2 users (show)

Fixed In Version: glusterfs-3.12.0
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2017-09-05 17:25:47 UTC
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Embargoed:


Attachments (Terms of Use)

Description Aravinda VK 2016-12-02 10:23:59 UTC
Description of problem:
Use rsync flag `--ignore-missing-args` to avoid rsync retries when file not exists in Source. Also use `--existing` to prevent failures if target file not exists.(Since Entry created using RPC calls)

Comment 1 Worker Ant 2016-12-02 10:25:52 UTC
REVIEW: http://review.gluster.org/16010 (geo-rep: Rsync tunables for performance improvements) posted (#1) for review on master by Aravinda VK (avishwan)

Comment 2 Worker Ant 2016-12-02 10:27:36 UTC
REVIEW: http://review.gluster.org/16010 (geo-rep: Rsync tunables for performance improvements) posted (#2) for review on master by Aravinda VK (avishwan)

Comment 3 Worker Ant 2017-05-22 11:38:52 UTC
REVIEW: https://review.gluster.org/16010 (geo-rep: Rsync tunables for performance improvements) posted (#3) for review on master by Aravinda VK (avishwan)

Comment 4 Worker Ant 2017-05-23 11:15:51 UTC
COMMIT: https://review.gluster.org/16010 committed in master by Aravinda VK (avishwan) 
------
commit 02979e4663ea9e8a925f785f206d1dba02f253c4
Author: Aravinda VK <avishwan>
Date:   Fri Dec 2 15:04:49 2016 +0530

    geo-rep: Rsync tunables for performance improvements
    
    Flag: --ignore-missing-args
    This Rsync flag reduces sync failures if the source file is
    unlinked but present in --files-from list. This reduces
    Rsync retries in Geo-rep and improves the performance
    
    Flag: --existing
    Rsync in Geo-rep never creates target files. Using RPC Geo-rep creates
    entry in Slave and rsync --inplace used to prevent creating temporary file
    and rename.(To avoid different GFID in Slave). If the entry is missing in
    Slave then Geo-rep Rsync gets Permission denied errors when it tries to
    create file with name as GFID inside .gfid dir.(Geo-rep rsync syncs data
    using GFIDS with aux-gfid-mount)
    
    To disable these flags,
    
        gluster volume geo-replication <session> config \
            rsync-opt-ignore-missing-args false
        gluster volume geo-replication <session> config \
            rsync-opt-existing false
    
    Thanks Kotresh for finding these awesome tunables.
    
    BUG: 1400924
    Change-Id: I6a84fb86a589bf6edc8dfd1086456a84b05a64fc
    Signed-off-by: Aravinda VK <avishwan>
    Reviewed-on: https://review.gluster.org/16010
    Smoke: Gluster Build System <jenkins.org>
    Reviewed-by: Amar Tumballi <amarts>
    NetBSD-regression: NetBSD Build System <jenkins.org>
    CentOS-regression: Gluster Build System <jenkins.org>
    Reviewed-by: Kotresh HR <khiremat>

Comment 5 Shyamsundar 2017-09-05 17:25:47 UTC
This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.12.0, please open a new bug report.

glusterfs-3.12.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution.

[1] http://lists.gluster.org/pipermail/announce/2017-September/000082.html
[2] https://www.gluster.org/pipermail/gluster-users/


Note You need to log in before you can comment on or make changes to this bug.