Bug 1091961 - libgfchangelog: API to consume historical changelog.
Summary: libgfchangelog: API to consume historical changelog.
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: GlusterFS
Classification: Community
Component: geo-replication
Version: mainline
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
Assignee: Ajeet Jha
QA Contact:
URL:
Whiteboard:
: 1096022 (view as bug list)
Depends On:
Blocks: 1097053
TreeView+ depends on / blocked
 
Reported: 2014-04-28 11:50 UTC by Kotresh HR
Modified: 2015-02-22 23:01 UTC (History)
5 users (show)

Fixed In Version: glusterfs-3.6.0beta1
Doc Type: Bug Fix
Doc Text:
Clone Of:
: 1097053 (view as bug list)
Environment:
Last Closed: 2014-11-11 08:31:16 UTC
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Embargoed:


Attachments (Terms of Use)

Description Kotresh HR 2014-04-28 11:50:20 UTC
Description of problem:

APIs to consume the changelog journals collected at the brick end given the start
and end Unix epoch time.
Currently this will be used by geo-replication to consume the changelog
available instead of xsync crawl. This can be used by back up applications as
well.

Please go through the following link for design and more details.

http://lists.nongnu.org/archive/html/gluster-devel/2014-02/msg00206.html

Comment 1 Anand Avati 2014-04-30 11:56:09 UTC
REVIEW: http://review.gluster.org/6930 (features/changelog : historical journal consumption.) posted (#9) for review on master by ajeet jha (ajha)

Comment 2 Anand Avati 2014-05-05 07:19:52 UTC
REVIEW: http://review.gluster.org/6930 (features/changelog : historical journal consumption.) posted (#10) for review on master by ajeet jha (ajha)

Comment 3 Anand Avati 2014-05-07 15:10:24 UTC
REVIEW: http://review.gluster.org/6930 (features/changelog : historical journal consumption.) posted (#11) for review on master by ajeet jha (ajha)

Comment 4 Kotresh HR 2014-05-08 04:25:03 UTC
This bug also tracks http://review.gluster.org/#/c/6998/

Comment 5 Anand Avati 2014-05-08 20:51:50 UTC
REVIEW: http://review.gluster.org/6930 (features/changelog : historical journal consumption.) posted (#12) for review on master by ajeet jha (ajha)

Comment 6 Anand Avati 2014-05-09 16:07:57 UTC
REVIEW: http://review.gluster.org/6930 (features/changelog : historical journal consumption.) posted (#13) for review on master by ajeet jha (ajha)

Comment 7 Anand Avati 2014-05-12 12:02:10 UTC
REVIEW: http://review.gluster.org/6930 (features/changelog : historical journal consumption.) posted (#14) for review on master by Venky Shankar (vshankar)

Comment 8 Anand Avati 2014-05-13 04:19:01 UTC
REVIEW: http://review.gluster.org/6930 (features/changelog : historical journal consumption.) posted (#15) for review on master by Venky Shankar (vshankar)

Comment 9 Anand Avati 2014-05-13 06:28:08 UTC
REVIEW: http://review.gluster.org/6930 (features/changelog : historical journal consumption.) posted (#16) for review on master by Venky Shankar (vshankar)

Comment 10 Anand Avati 2014-05-13 06:34:02 UTC
REVIEW: http://review.gluster.org/7747 (geo-rep: Changelog History API changes) posted (#1) for review on master by Aravinda VK (avishwan)

Comment 11 Anand Avati 2014-05-13 08:40:44 UTC
REVIEW: http://review.gluster.org/6930 (features/changelog : historical journal consumption.) posted (#17) for review on master by ajeet jha (ajha)

Comment 12 Anand Avati 2014-05-13 10:54:51 UTC
REVIEW: http://review.gluster.org/6930 (features/changelog : historical journal consumption.) posted (#18) for review on master by ajeet jha (ajha)

Comment 13 Anand Avati 2014-05-13 11:19:11 UTC
REVIEW: http://review.gluster.org/6930 (features/changelog : historical journal consumption.) posted (#19) for review on master by Venky Shankar (vshankar)

Comment 14 Anand Avati 2014-05-13 17:22:01 UTC
COMMIT: http://review.gluster.org/7747 committed in master by Venky Shankar (vshankar) 
------
commit ba9aec54be5b8f00125ad018618a86de769fb6b5
Author: Aravinda VK <avishwan>
Date:   Tue May 13 11:56:50 2014 +0530

    geo-rep: Changelog History API changes
    
    Additional argument added to API gf_history_changelog,
    actual_end - The end time till where changelogs are available.
    
    Added sort to history_get_changes API output.
    
    BUG: 1091961
    Change-Id: Id043409882a83cd0a7b9adc3d34d5147d17e532e
    Signed-off-by: Aravinda VK <avishwan>
    Reviewed-on: http://review.gluster.org/7747
    Reviewed-by: ajeet jha <ajha>
    Reviewed-by: Venky Shankar <vshankar>
    Tested-by: Venky Shankar <vshankar>

Comment 15 Anand Avati 2014-05-14 12:10:38 UTC
COMMIT: http://review.gluster.org/6930 committed in master by Venky Shankar (vshankar) 
------
commit d2db585ce7e26851178104433fa9422482d8719e
Author: Venky Shankar <vshankar>
Date:   Wed Feb 19 20:47:46 2014 +0530

    features/changelog : historical journal consumption.
    
    Facilitates Glusterfs with the ability to detect file-operations
    happened in past by scanning the back-end(brick-level) glusterfs
    journal (changelog).
    
    Design:
      * List of changelogs produces in one perfectly running session are
        stored in htime file which also holds necessary information about
        the session start and end time.
      * Involves fixed sized seeks to identify N'th changelog in the list.
      * Requires O(log n), (where n is number of changelogs in the list),
        time to identify the end changelog for the given start-end time
        interval.
    
    Currently the background processing of changelogs is sub optimal. BZ
    1097041 tracks the development effort.
    
    For complete design, refer the below link:
    http://lists.nongnu.org/archive/html/gluster-devel/2014-02/msg00206.html
    
    Change-Id: I27e49f75e492e843084d0ecaf9130224d08462a0
    BUG: 1091961
    Signed-off-by: Ajeet Jha <ajha>
    Signed-off-by: Venky Shankar <vshankar>
    Signed-off-by: Ajeet Jha <ajha>
    Reviewed-on: http://review.gluster.org/6930
    Reviewed-by: Kotresh HR <khiremat>
    Tested-by: Gluster Build System <jenkins.com>

Comment 16 Niels de Vos 2014-07-13 11:00:35 UTC
*** Bug 1096022 has been marked as a duplicate of this bug. ***

Comment 17 Niels de Vos 2014-09-22 12:39:13 UTC
A beta release for GlusterFS 3.6.0 has been released. Please verify if the release solves this bug report for you. In case the glusterfs-3.6.0beta1 release does not have a resolution for this issue, leave a comment in this bug and move the status to ASSIGNED. If this release fixes the problem for you, leave a note and change the status to VERIFIED.

Packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update (possibly an "updates-testing" repository) infrastructure for your distribution.

[1] http://supercolony.gluster.org/pipermail/gluster-users/2014-September/018836.html
[2] http://supercolony.gluster.org/pipermail/gluster-users/

Comment 18 Niels de Vos 2014-11-11 08:31:16 UTC
This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.6.1, please reopen this bug report.

glusterfs-3.6.1 has been announced [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution.

[1] http://supercolony.gluster.org/pipermail/gluster-users/2014-November/019410.html
[2] http://supercolony.gluster.org/mailman/listinfo/gluster-users


Note You need to log in before you can comment on or make changes to this bug.