Bug 1294743

Summary:	Lot of Inode not found messages in glfsheal log file
Product:	[Community] GlusterFS	Reporter:	Pranith Kumar K <pkarampu>
Component:	disperse	Assignee:	Pranith Kumar K <pkarampu>
Status:	CLOSED CURRENTRELEASE	QA Contact:
Severity:	unspecified	Docs Contact:
Priority:	unspecified
Version:	mainline	CC:	bugs, byarlaga, pkarampu
Target Milestone:	---	Keywords:	ZStream
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:	glusterfs-3.8rc2	Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:	1294059
Clones:	1302943 (view as bug list)		Environment:
Last Closed:	2016-06-16 13:52:41 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:	1294059
Bug Blocks:	1302943

Comment 1 Pranith Kumar K 2015-12-30 04:55:07 UTC

Seeing lot of inode not found messages in glfsheal log file.

This is on a 4+2 ec volume and 2x2 tier attached to it. Was running brick down and heal info commands

[2015-12-24 10:23:47.397946] W [inode.c:646:inode_new] (-->/usr/sbin/glfsheal(+0x2ab1) [0x7f36f0c27ab1] -->/lib64/libglusterfs.so.0(syncop_gfid_to_path+0x5c) [0x7f36f07bd6fc] -->/lib64/libglusterfs.so.0(inode_new+0x8c) [0x7f36f077bf4c] ) 0-dpvol-disperse-0: inode not found
[2015-12-24 10:23:47.398344] W [inode.c:646:inode_new] (-->/usr/sbin/glfsheal(+0x2ab1) [0x7f36f0c27ab1] -->/lib64/libglusterfs.so.0(syncop_gfid_to_path+0x5c) [0x7f36f07bd6fc] -->/lib64/libglusterfs.so.0(inode_new+0x8c) [0x7f36f077bf4c] ) 0-dpvol-disperse-0: inode not found
[2015-12-24 10:23:47.398544] W [inode.c:646:inode_new] (-->/usr/sbin/glfsheal(+0x2ab1) [0x7f36f0c27ab1] -->/lib64/libglusterfs.so.0(syncop_gfid_to_path+0x5c) [0x7f36f07bd6fc] -->/lib64/libglusterfs.so.0(inode_new+0x8c) [0x7f36f077bf4c] ) 0-dpvol-disperse-0: inode not found
[2015-12-24 10:23:47.398748] W [inode.c:646:inode_new] (-->/usr/sbin/glfsheal(+0x2ab1) [0x7f36f0c27ab1] -->/lib64/libglusterfs.so.0(syncop_gfid_to_path+0x5c) [0x7f36f07bd6fc] -->/lib64/libglusterfs.so.0(inode_new+0x8c) [0x7f36f077bf4c] ) 0-dpvol-disperse-0: inode not found
[2015-12-24 10:23:47.399003] W [inode.c:646:inode_new] (-->/usr/sbin/glfsheal(+0x2ab1) [0x7f36f0c27ab1] -->/lib64/libglusterfs.so.0(syncop_gfid_to_path+0x5c) [0x7f36f07bd6fc] -->/lib64/libglusterfs.so.0(inode_new+0x8c) [0x7f36f077bf4c] ) 0-dpvol-disperse-0: inode not found
[2015-12-24 10:23:47.399204] W [inode.c:646:inode_new] (-->/usr/sbin/glfsheal(+0x2ab1) [0x7f36f0c27ab1] -->/lib64/libglusterfs.so.0(syncop_gfid_to_path+0x5c) [0x7f36f07bd6fc] -->/lib64/libglusterfs.so.0(inode_new+0x8c) [0x7f36f077bf4c] ) 0-dpvol-disperse-0: inode not found
[2015-12-24 10:23:47.399392] W [inode.c:646:inode_new] (-->/usr/sbin/glfsheal(+0x2ab1) [0x7f36f0c27ab1] -->/lib64/libglusterfs.so.0(syncop_gfid_to_path+0x5c) [0x7f36f07bd6fc] -->/lib64/libglusterfs.so.0(inode_new+0x8c) [0x7f36f077bf4c] ) 0-dpvol-disperse-0: inode not found
[2015-12-24 10:23:47.399579] W [inode.c:646:inode_new] (-->/usr/sbin/glfsheal(+0x2ab1) [0x7f36f0c27ab1] -->/lib64/libglusterfs.so.0(syncop_gfid_to_path+0x5c) [0x7f36f07bd6fc] -->/lib64/libglusterfs.so.0(inode_new+0x8c) [0x7f36f077bf4c] ) 0-dpvol-disperse-0: inode not found

Comment 2 Vijay Bellur 2015-12-30 04:56:01 UTC

REVIEW: http://review.gluster.org/13112 (cluster/ec: Create this->itable in all cases) posted (#1) for review on master by Pranith Kumar Karampuri (pkarampu)

Comment 3 Vijay Bellur 2016-01-06 04:53:15 UTC

REVIEW: http://review.gluster.org/13112 (cluster/ec: Create this->itable in all cases) posted (#2) for review on master by Pranith Kumar Karampuri (pkarampu)

Comment 4 Vijay Bellur 2016-01-29 01:46:13 UTC

REVIEW: http://review.gluster.org/13112 (cluster/ec: Create this->itable in all cases) posted (#3) for review on master by Pranith Kumar Karampuri (pkarampu)

Comment 5 Vijay Bellur 2016-01-29 05:13:06 UTC

COMMIT: http://review.gluster.org/13112 committed in master by Pranith Kumar Karampuri (pkarampu) 
------
commit 080ddb79d8805253a7f4274606351570faae1add
Author: Pranith Kumar K <pkarampu>
Date:   Wed Dec 30 10:17:00 2015 +0530

    cluster/ec: Create this->itable in all cases
    
    Problem:
    glfsheal operates based on mount's volfile which doesn't have iamshd flag due
    to which this->itable is NULL, this leads to "inode not found" logs in glfsheal
    logs.
    
    Fix:
    Ec only allocates itable with 10 inodes, so allocating this->itable in all
    cases in init.
    
    Change-Id: I01d3c05e93a17007a4716a2d6f392d2aa306a34b
    BUG: 1294743
    Signed-off-by: Pranith Kumar K <pkarampu>
    Reviewed-on: http://review.gluster.org/13112
    Smoke: Gluster Build System <jenkins.com>
    NetBSD-regression: NetBSD Build System <jenkins.org>
    CentOS-regression: Gluster Build System <jenkins.com>

Comment 6 Mike McCune 2016-03-28 23:18:47 UTC

This bug was accidentally moved from POST to MODIFIED via an error in automation, please see mmccune with any questions

Comment 7 Niels de Vos 2016-06-16 13:52:41 UTC

This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.8.0, please open a new bug report.

glusterfs-3.8.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution.

[1] http://blog.gluster.org/2016/06/glusterfs-3-8-released/
[2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user