Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1480445

Summary:	Log entry of files skipped/failed during rebalance operation
Product:	[Community] GlusterFS	Reporter:	Nithya Balachandran <nbalacha>
Component:	distribute	Assignee:	Nithya Balachandran <nbalacha>
Status:	CLOSED CURRENTRELEASE	QA Contact:
Severity:	high	Docs Contact:
Priority:	high
Version:	mainline	CC:	amukherj, bkunal, bugs, rhs-bugs, spalai, storage-qa-internal, tdesala
Target Milestone:	---	Keywords:	FutureFeature, ZStream
Target Release:	---
Hardware:	x86_64
OS:	Linux
Whiteboard:
Fixed In Version:	glusterfs-3.13.0	Doc Type:	Enhancement
Doc Text:		Story Points:	---
Clone Of:	1463114
Clones:	1486557 (view as bug list)		Environment:
Last Closed:	2017-12-08 17:37:20 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:
Bug Blocks:	1463114, 1486557, 1531936

Description Nithya Balachandran 2017-08-11 06:34:14 UTC

+++ This bug was initially created as a clone of Bug #1463114 +++

Description of problem:

As of now rebalance status just indicate the count of failed and skipped entries. This information should be more informative and should even give the list of files so that list can be used to manually operate and complete rebalancing.



  Good to have list of files in a separate log file. Preferable would be to have file path and not gfid. 
   We should log in such a way that it can be consumed easily even if the list is long.
   With this fix we should even create a way/script to consume the list and make the life of Admin easier. As of now doing it manually is a tough job.

So here we have 3 requirements :
   1) Get the list of files failed or skipped with error messages
   2) Automatically consume those file list to complete rebalance( This can be triggered manually)
   3) If not able to consume list, list the file with some reason of failure

Comment 1 Nithya Balachandran 2017-08-11 06:44:32 UTC

Skipped files are now logged in the rebalance log :

2017-08-11 05:33:01.464620] I [MSGID: 109126] [dht-rebalance.c:2681:gf_defrag_migrate_single_file] 0-vol1-dht: File migration skipped for /NEWFILE-1.


Users can search for the msgid [109126] for the list of skipped files.

Comment 2 Worker Ant 2017-08-11 06:50:34 UTC

REVIEW: https://review.gluster.org/18021 (cluster/dht:  Log files skipped by rebalance) posted (#1) for review on master by N Balachandran (nbalacha)

Comment 3 Worker Ant 2017-08-30 05:56:19 UTC

COMMIT: https://review.gluster.org/18021 committed in master by Raghavendra G (rgowdapp) 
------
commit a4c43ba9374b8f75a48d38a032353a0c7d311a73
Author: N Balachandran <nbalacha>
Date:   Fri Aug 11 12:16:12 2017 +0530

    cluster/dht:  Log files skipped by rebalance
    
    There was no easy way to find out which files were
    skipped during a rebalance.
    Rebalance now logs a message for every skipped file
    using msgid 109126, making it easier to find
    all files that were skipped.
    
    Change-Id: I2cac7db7285e2f82354251f3ea4094827b0daf3e
    BUG: 1480445
    Signed-off-by: N Balachandran <nbalacha>
    Reviewed-on: https://review.gluster.org/18021
    Smoke: Gluster Build System <jenkins.org>
    CentOS-regression: Gluster Build System <jenkins.org>
    Reviewed-by: hari gowtham <hari.gowtham005>
    Reviewed-by: Raghavendra G <rgowdapp>

Comment 4 Shyamsundar 2017-12-08 17:37:20 UTC

This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.13.0, please open a new bug report.

glusterfs-3.13.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution.

[1] http://lists.gluster.org/pipermail/announce/2017-December/000087.html
[2] https://www.gluster.org/pipermail/gluster-users/