Bug 1193893 - [FEAT] Tool to find incremental changes from GlusterFS Volume
Summary: [FEAT] Tool to find incremental changes from GlusterFS Volume
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: GlusterFS
Classification: Community
Component: unclassified
Version: mainline
Hardware: Unspecified
OS: Unspecified
low
unspecified
Target Milestone: ---
Assignee: Aravinda VK
QA Contact:
URL:
Whiteboard:
Depends On: 826768
Blocks:
TreeView+ depends on / blocked
 
Reported: 2015-02-18 14:04 UTC by Aravinda VK
Modified: 2015-07-29 15:01 UTC (History)
7 users (show)

Fixed In Version: glusterfs-3.7.0
Doc Type: Enhancement
Doc Text:
Clone Of: 826768
Environment:
Last Closed: 2015-05-14 17:29:09 UTC
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Embargoed:


Attachments (Terms of Use)

Description Aravinda VK 2015-02-18 14:04:20 UTC
+++ This bug was initially created as a clone of Bug #826768 +++

Ability for intelligent backing up of data in Gluster volumes. New translator? Documented sequence of steps? Integration with an existing backup solution?

Comment 1 Anand Avati 2015-02-18 14:06:05 UTC
REVIEW: http://review.gluster.org/9682 ([WIP] GlusterFS backup helper) posted (#1) for review on master by Aravinda VK (avishwan)

Comment 2 Anand Avati 2015-02-19 14:06:45 UTC
REVIEW: http://review.gluster.org/9682 ([WIP] GlusterFS backup helper) posted (#2) for review on master by Aravinda VK (avishwan)

Comment 3 Anand Avati 2015-02-20 12:11:56 UTC
REVIEW: http://review.gluster.org/9682 ([WIP] GlusterFS backup helper) posted (#3) for review on master by Aravinda VK (avishwan)

Comment 4 Anand Avati 2015-02-25 06:54:32 UTC
REVIEW: http://review.gluster.org/9682 (GlusterFS backup helper) posted (#4) for review on master by Aravinda VK (avishwan)

Comment 5 Anand Avati 2015-02-25 06:56:32 UTC
REVIEW: http://review.gluster.org/9682 (GlusterFS backup helper) posted (#5) for review on master by Aravinda VK (avishwan)

Comment 6 Anand Avati 2015-02-25 10:07:36 UTC
REVIEW: http://review.gluster.org/9682 (GlusterFS backup helper) posted (#6) for review on master by Aravinda VK (avishwan)

Comment 7 Justin Clift 2015-02-25 21:28:29 UTC
This seems like the upstream version of a RHS BZ.  Can this be public, instead of private?  The patches in Gerrit themselves all are... ;)

Comment 8 Anand Avati 2015-03-03 02:36:52 UTC
REVIEW: http://review.gluster.org/9682 (Incremental API for GlusterFS) posted (#7) for review on master by Aravinda VK (avishwan)

Comment 9 Anand Avati 2015-03-03 19:12:25 UTC
REVIEW: http://review.gluster.org/9682 (Incremental API for GlusterFS) posted (#8) for review on master by Aravinda VK (avishwan)

Comment 10 Anand Avati 2015-03-04 10:51:35 UTC
REVIEW: http://review.gluster.org/9682 (Incremental API for GlusterFS) posted (#9) for review on master by Aravinda VK (avishwan)

Comment 11 Anand Avati 2015-03-05 12:01:26 UTC
REVIEW: http://review.gluster.org/9682 (feature: glusterfind - A tool to find incremental changes) posted (#10) for review on master by Aravinda VK (avishwan)

Comment 12 Anand Avati 2015-03-05 12:01:52 UTC
REVIEW: http://review.gluster.org/9682 (feature/glusterfind: A tool to find incremental changes) posted (#11) for review on master by Aravinda VK (avishwan)

Comment 13 Anand Avati 2015-03-06 09:29:49 UTC
REVIEW: http://review.gluster.org/9682 (feature/glusterfind: A tool to find incremental changes) posted (#12) for review on master by Aravinda VK (avishwan)

Comment 14 Anand Avati 2015-03-10 07:37:30 UTC
REVIEW: http://review.gluster.org/9682 (feature/glusterfind: A tool to find incremental changes) posted (#13) for review on master by Aravinda VK (avishwan)

Comment 15 Anand Avati 2015-03-10 10:48:21 UTC
REVIEW: http://review.gluster.org/9682 (feature/glusterfind: A tool to find incremental changes) posted (#14) for review on master by Aravinda VK (avishwan)

Comment 16 Anand Avati 2015-03-11 16:43:04 UTC
REVIEW: http://review.gluster.org/9682 (feature/glusterfind: A tool to find incremental changes) posted (#15) for review on master by Aravinda VK (avishwan)

Comment 17 Anand Avati 2015-03-12 07:59:23 UTC
REVIEW: http://review.gluster.org/9682 (feature/glusterfind: A tool to find incremental changes) posted (#16) for review on master by Aravinda VK (avishwan)

Comment 18 Anand Avati 2015-03-16 01:44:58 UTC
REVIEW: http://review.gluster.org/9800 (doc: document glusterfind feature) posted (#2) for review on master by Aravinda VK (avishwan)

Comment 19 Anand Avati 2015-03-16 03:43:57 UTC
REVIEW: http://review.gluster.org/9682 (feature/glusterfind: A tool to find incremental changes) posted (#17) for review on master by Aravinda VK (avishwan)

Comment 20 Anand Avati 2015-03-16 06:22:26 UTC
REVIEW: http://review.gluster.org/9682 (feature/glusterfind: A tool to find incremental changes) posted (#18) for review on master by Aravinda VK (avishwan)

Comment 21 Anand Avati 2015-03-16 08:03:13 UTC
REVIEW: http://review.gluster.org/9682 (feature/glusterfind: A tool to find incremental changes) posted (#19) for review on master by Aravinda VK (avishwan)

Comment 22 Anand Avati 2015-03-16 13:35:29 UTC
REVIEW: http://review.gluster.org/9682 (feature/glusterfind: A tool to find incremental changes) posted (#20) for review on master by Aravinda VK (avishwan)

Comment 23 Anand Avati 2015-03-17 16:48:55 UTC
REVIEW: http://review.gluster.org/9682 (feature/glusterfind: A tool to find incremental changes) posted (#21) for review on master by Aravinda VK (avishwan)

Comment 24 Anand Avati 2015-03-18 09:54:29 UTC
COMMIT: http://review.gluster.org/9682 committed in master by Vijay Bellur (vbellur) 
------
commit 7e98a0e0b1e346f89047b57e495f66f1b4223997
Author: Aravinda VK <avishwan>
Date:   Wed Feb 18 19:07:23 2015 +0530

    feature/glusterfind: A tool to find incremental changes
    
    Documentation is available in patch:
    http://review.gluster.org/#/c/9800/
    
    A tool which helps to get list of modified files or list of all files in
    GlusterFS Volume using Changelog or find command.
    
    Usage
    =====
    glusterfind --help
    
    Create:
    -------
    glusterfind create --help
    
    The tool creates status file $GLUSTERD_WORKDIR/SESSION/VOLUME/status
    and records current timestamp to initiate the session. This timestamp
    will be used as start time for next runs.
    
    As part of create also generates ssh key and distributes to all peers.
    and enables build.pgfid and changelog using volume set command.
    
    Pre:
    ----
    glusterfind pre --help
    
    This command is used to generate the list of files modified after session
    creation time or after last run. To get list of all files/dirs in Volume,
    run pre command with `--full` argument.
    
    The tool gets all nodes details using gluster volume info and runs node
    agent for each brick in respective nodes via ssh command. Once these node
    agents generate the output file, tool copies to local using scp. Merges all
    the output files to generate the final output file.
    
    Post:
    -----
    glusterfind post --help
    
    After consuming the list, this sub command is called to update the session
    time based on pre command status file.
    
    List:
    -----
    glusterfind list --help
    
    To view all the sessions
    
    Delete:
    -------
    glusterfind delete --help
    
    Delete session.
    
    Known Issues
    ------------
    1. Deleted files will not get listed, since we can't convert GFID to
       Path if file/dir is deleted.
    2. Only new name will get listed if Renamed.
    3. All hardlinks will get listed.
    
    Change-Id: I82991feb0aea85cb6ec035fddbf80a2b276e86b0
    BUG: 1193893
    Signed-off-by: Aravinda VK <avishwan>
    Reviewed-on: http://review.gluster.org/9682
    Tested-by: Gluster Build System <jenkins.com>
    Reviewed-by: Venky Shankar <vshankar>
    Reviewed-by: Prashanth Pai <ppai>
    Reviewed-by: Kotresh HR <khiremat>
    Reviewed-by: Vijay Bellur <vbellur>

Comment 25 Anand Avati 2015-03-18 09:57:40 UTC
COMMIT: http://review.gluster.org/9800 committed in master by Vijay Bellur (vbellur) 
------
commit 1bf69fc65d777e1bbea28619c144a9cb373b47ab
Author: Aravinda VK <avishwan>
Date:   Thu Mar 5 00:54:36 2015 +0530

    doc: document glusterfind feature
    
    Change-Id: I759f05d63028d6a52c3e1ee2ab9892583c4832e7
    BUG: 1193893
    Signed-off-by: Aravinda VK <avishwan>
    Reviewed-on: http://review.gluster.org/9800
    Tested-by: Gluster Build System <jenkins.com>
    Reviewed-by: Kotresh HR <khiremat>
    Reviewed-by: Vijay Bellur <vbellur>

Comment 26 Niels de Vos 2015-05-14 17:29:09 UTC
This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.7.0, please open a new bug report.

glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution.

[1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939
[2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user

Comment 27 Niels de Vos 2015-05-14 17:35:50 UTC
This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.7.0, please open a new bug report.

glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution.

[1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939
[2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user

Comment 28 Niels de Vos 2015-05-14 17:38:12 UTC
This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.7.0, please open a new bug report.

glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution.

[1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939
[2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user

Comment 29 Niels de Vos 2015-05-14 17:46:00 UTC
This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.7.0, please open a new bug report.

glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution.

[1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939
[2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user


Note You need to log in before you can comment on or make changes to this bug.