Bug 1686353

Summary:	flooding of "dict is NULL" logging
Product:	[Community] GlusterFS	Reporter:	ryan
Component:	libgfapi	Assignee:	bugs <bugs>
Status:	CLOSED CURRENTRELEASE	QA Contact:	bugs <bugs>
Severity:	medium	Docs Contact:
Priority:	unspecified
Version:	4.1	CC:	atumball, bugs, eimantaszd, pasik
Target Milestone:	---
Target Release:	---
Hardware:	x86_64
OS:	Linux
Whiteboard:
Fixed In Version:	glusterfs-6.x, glusterfs-5.5	Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2019-05-27 16:29:22 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description ryan 2019-03-07 10:13:24 UTC

Description of problem:
Same issue as in bug 1313567, but is happening with VFS clients.

Version-Release number of selected component (if applicable):
4.1.7

How reproducible:
Every gluster system upgraded to 4.1.7


Steps to Reproduce:
1.Upgrade 3.12 system to 4.1.7

Actual results:
Log file is filled with error and eventually consumes all available storage space

Expected results:
Log file is not filled with error


Additional info:

Comment 1 ryan 2019-03-07 10:30:49 UTC

Errors in log:
[2019-03-07 10:24:23.718001] W [dict.c:671:dict_ref] (-->/usr/lib64/glusterfs/4.1.7/xlator/performance/quick-read.so(+0x5db4) [0x7f8efe647db4] -->/usr/lib64/glusterfs/4.1.7/xlator/performance/io-cache.so(+0xae2e) [0x7f8efe858e2e] -->/lib64/libglusterfs.so.0(dict_ref+0x5d) [0x7f8f095adf1d] ) 0-dict: dict is NULL [Invalid argument]
[2019-03-07 10:24:23.719257] W [dict.c:671:dict_ref] (-->/usr/lib64/glusterfs/4.1.7/xlator/performance/quick-read.so(+0x5db4) [0x7f8efe647db4] -->/usr/lib64/glusterfs/4.1.7/xlator/performance/io-cache.so(+0xae2e) [0x7f8efe858e2e] -->/lib64/libglusterfs.so.0(dict_ref+0x5d) [0x7f8f095adf1d] ) 0-dict: dict is NULL [Invalid argument]
[2019-03-07 10:24:23.720557] W [dict.c:671:dict_ref] (-->/usr/lib64/glusterfs/4.1.7/xlator/performance/quick-read.so(+0x5db4) [0x7f8efe647db4] -->/usr/lib64/glusterfs/4.1.7/xlator/performance/io-cache.so(+0xae2e) [0x7f8efe858e2e] -->/lib64/libglusterfs.so.0(dict_ref+0x5d) [0x7f8f095adf1d] ) 0-dict: dict is NULL [Invalid argument]
[2019-03-07 10:24:23.722291] W [dict.c:671:dict_ref] (-->/usr/lib64/glusterfs/4.1.7/xlator/performance/quick-read.so(+0x5db4) [0x7f8efe647db4] -->/usr/lib64/glusterfs/4.1.7/xlator/performance/io-cache.so(+0xae2e) [0x7f8efe858e2e] -->/lib64/libglusterfs.so.0(dict_ref+0x5d) [0x7f8f095adf1d] ) 0-dict: dict is NULL [Invalid argument]
[2019-03-07 10:24:24.457847] W [dict.c:671:dict_ref] (-->/usr/lib64/glusterfs/4.1.7/xlator/performance/quick-read.so(+0x5db4) [0x7f8efe647db4] -->/usr/lib64/glusterfs/4.1.7/xlator/performance/io-cache.so(+0xae2e) [0x7f8efe858e2e] -->/lib64/libglusterfs.so.0(dict_ref+0x5d) [0x7f8f095adf1d] ) 0-dict: dict is NULL [Invalid argument]
[2019-03-07 10:24:24.457888] W [dict.c:671:dict_ref] (-->/usr/lib64/glusterfs/4.1.7/xlator/performance/quick-read.so(+0x5db4) [0x7f8efe647db4] -->/usr/lib64/glusterfs/4.1.7/xlator/performance/io-cache.so(+0xae2e) [0x7f8efe858e2e] -->/lib64/libglusterfs.so.0(dict_ref+0x5d) [0x7f8f095adf1d] ) 0-dict: dict is NULL [Invalid argument]
[2019-03-07 10:24:24.458852] W [dict.c:671:dict_ref] (-->/usr/lib64/glusterfs/4.1.7/xlator/performance/quick-read.so(+0x5db4) [0x7f8efe647db4] -->/usr/lib64/glusterfs/4.1.7/xlator/performance/io-cache.so(+0xae2e) [0x7f8efe858e2e] -->/lib64/libglusterfs.so.0(dict_ref+0x5d) [0x7f8f095adf1d] ) 0-dict: dict is NULL [Invalid argument]
[2019-03-07 10:24:24.458907] W [dict.c:671:dict_ref] (-->/usr/lib64/glusterfs/4.1.7/xlator/performance/quick-read.so(+0x5db4) [0x7f8efe647db4] -->/usr/lib64/glusterfs/4.1.7/xlator/performance/io-cache.so(+0xae2e) [0x7f8efe858e2e] -->/lib64/libglusterfs.so.0(dict_ref+0x5d) [0x7f8f095adf1d] ) 0-dict: dict is NULL [Invalid argument]
[2019-03-07 10:24:24.459093] W [dict.c:671:dict_ref] (-->/usr/lib64/glusterfs/4.1.7/xlator/performance/quick-read.so(+0x5db4) [0x7f8efe647db4] -->/usr/lib64/glusterfs/4.1.7/xlator/performance/io-cache.so(+0xae2e) [0x7f8efe858e2e] -->/lib64/libglusterfs.so.0(dict_ref+0x5d) [0x7f8f095adf1d] ) 0-dict: dict is NULL [Invalid argument]

Comment 2 Amar Tumballi 2019-05-27 16:29:22 UTC

This got fixed in glusterfs-5.5 (or glusterfs-6.1). Please upgrade.

Comment 3 ryan 2019-05-28 10:05:54 UTC

Hi Amar,

Has this been back-ported to Gluster 4?

Comment 4 Amar Tumballi 2019-05-28 10:17:39 UTC

Ryan, considering there was no release of 4.1.x branch, this was not backported. Best thing is to upgrade to 5.6 or 6.1 right now.