Bug 1387990 - [RFE] Geo-replication Logging Improvements
Summary: [RFE] Geo-replication Logging Improvements
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: GlusterFS
Classification: Community
Component: geo-replication
Version: 3.9
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
Assignee: Aravinda VK
QA Contact:
URL:
Whiteboard:
Depends On: 1359612
Blocks: 1359613
TreeView+ depends on / blocked
 
Reported: 2016-10-24 07:02 UTC by Aravinda VK
Modified: 2016-12-06 05:59 UTC (History)
1 user (show)

Fixed In Version: glusterfs-3.9.0
Clone Of: 1359612
Environment:
Last Closed: 2016-12-06 05:59:25 UTC
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Embargoed:


Attachments (Terms of Use)

Description Aravinda VK 2016-10-24 07:02:49 UTC
+++ This bug was initially created as a clone of Bug #1359612 +++

Description of problem:

Many improvements can be made to Geo-replication logs to understand the current status and other details.

- Session Creation/Recreation - Will help to understand when session was first created/recreated

- Log the push-pem status(Since hook script runs in background)

- On Start,
    . Monitor Start Message
    . Number of local bricks
    . Worker Start Message with respective Slave node to which it is trying to connect
    . Agent Start Message

- Worker State Changes
    . Change in connected Slave Node
    . Change in Status(Initializing/Active/Passive/Faulty/Stopped/Paused/Resumed)
    . Change in Crawl(Hybrid/History/Changelog)

- Checkpoint Set and Completion Time

- Sync time logs:
  If Rsync failure, Summary of errors (CHANGELOG start-end name and error)

- When Config Changed, log CONFIG_NAME OLD_VALUE and NEW_VALUE

- On worker restart,
   Log last worker's and agents uptime (Because monitor knows about it :P)

- Performance metrics: (Optional only if enabled)
    - After each Changelog batch processed
        - Number of Changelogs processed and START and END changelog
        - Number of ENTRY, DATA and META
        - Time took to Parse Changelogs, Entry Operations, Meta and Sync

--- Additional comment from Worker Ant on 2016-10-20 05:42:39 EDT ---

REVIEW: http://review.gluster.org/15684 (geo-rep: Logging improvements) posted (#1) for review on master by Aravinda VK (avishwan)

--- Additional comment from Worker Ant on 2016-10-24 03:01:53 EDT ---

COMMIT: http://review.gluster.org/15684 committed in master by Aravinda VK (avishwan) 
------
commit cdc30ed8eacb6772e0dabb863ef51cef794d60dd
Author: Aravinda VK <avishwan>
Date:   Thu Oct 20 15:05:38 2016 +0530

    geo-rep: Logging improvements
    
    - Redundant log messages removed.
    - Worker and connected slave node details added in "starting worker" log
    - Added log for Monitor state change
    - Added log for Worker status change(Initializing/Active/Passive/Faulty)
    - Added log for Crawl status Change
    - Added log for config set and reset
    - Added log for checkpoint set, reset and completion
    
    BUG: 1359612
    Change-Id: Icc7173ff3c93de4b862bdb1a61760db7eaf14271
    Signed-off-by: Aravinda VK <avishwan>
    Reviewed-on: http://review.gluster.org/15684
    Smoke: Gluster Build System <jenkins.org>
    NetBSD-regression: NetBSD Build System <jenkins.org>
    CentOS-regression: Gluster Build System <jenkins.org>
    Reviewed-by: Kotresh HR <khiremat>

Comment 1 Worker Ant 2016-10-24 07:04:07 UTC
REVIEW: http://review.gluster.org/15710 (geo-rep: Logging improvements) posted (#1) for review on release-3.9 by Aravinda VK (avishwan)

Comment 2 Worker Ant 2016-10-25 07:22:05 UTC
COMMIT: http://review.gluster.org/15710 committed in release-3.9 by Aravinda VK (avishwan) 
------
commit 12907e86e571cd77cc57bff024453b90baa34b72
Author: Aravinda VK <avishwan>
Date:   Thu Oct 20 15:05:38 2016 +0530

    geo-rep: Logging improvements
    
    - Redundant log messages removed.
    - Worker and connected slave node details added in "starting worker" log
    - Added log for Monitor state change
    - Added log for Worker status change(Initializing/Active/Passive/Faulty)
    - Added log for Crawl status Change
    - Added log for config set and reset
    - Added log for checkpoint set, reset and completion
    
    > Reviewed-on: http://review.gluster.org/15684
    > Smoke: Gluster Build System <jenkins.org>
    > NetBSD-regression: NetBSD Build System <jenkins.org>
    > CentOS-regression: Gluster Build System <jenkins.org>
    > Reviewed-by: Kotresh HR <khiremat>
    
    BUG: 1387990
    Change-Id: Icc7173ff3c93de4b862bdb1a61760db7eaf14271
    Signed-off-by: Aravinda VK <avishwan>
    (cherry picked from commit cdc30ed8eacb6772e0dabb863ef51cef794d60dd)
    Reviewed-on: http://review.gluster.org/15710
    Smoke: Gluster Build System <jenkins.org>
    NetBSD-regression: NetBSD Build System <jenkins.org>
    CentOS-regression: Gluster Build System <jenkins.org>
    Reviewed-by: Kotresh HR <khiremat>

Comment 3 Aravinda VK 2016-10-27 05:22:25 UTC
glusterfs-3.9.0rc2 is released[1] and packages are available for different distributions[2] to test.

[1] http://www.gluster.org/pipermail/maintainers/2016-October/001601.html
[2] http://www.gluster.org/pipermail/maintainers/2016-October/001605.html and http://www.gluster.org/pipermail/maintainers/2016-October/001606.html

Comment 4 Aravinda VK 2016-12-06 05:59:25 UTC
Gluster 3.9 GA is released http://blog.gluster.org/2016/11/announcing-gluster-3-9/


Note You need to log in before you can comment on or make changes to this bug.