Bug 1413502

Summary: [Ganesha] : Ganesha crashes on all nodes when Ganesha service is stopped
Product: [Red Hat Storage] Red Hat Gluster Storage Reporter: Ambarish <asoman>
Component: nfs-ganeshaAssignee: Jiffin <jthottan>
Status: CLOSED ERRATA QA Contact: Ambarish <asoman>
Severity: high Docs Contact:
Priority: unspecified    
Version: rhgs-3.2CC: amukherj, asoman, bturner, dang, ffilz, jthottan, kkeithle, mbenjamin, rcyriac, rhinduja, rhs-bugs, sbhaloth, skoduri, storage-qa-internal
Target Milestone: ---   
Target Release: RHGS 3.2.0   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: nfs-ganesha-2.4.1-6 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2017-03-23 06:28:52 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1351528    

Description Ambarish 2017-01-16 08:38:16 UTC 
Description of problem:
------------------------

Ganesha crashed on service nfs-ganesha stop on all the nodes and dumped the following core :

#0  0x00007f77480c6740 in mdc_cur_export ()
    at /usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_int.h:384
#1  mdcache_lru_clean (entry=0x7f7749af35c0)
    at /usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_lru.c:421
#2  mdcache_lru_unref (entry=entry@entry=0x7f7749af35c0, flags=flags@entry=0)
    at /usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_lru.c:1464
#3  0x00007f77480d5289 in cih_remove_checked (entry=0x7f7749af35c0)
    at /usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_hash.h:407
#4  _mdcache_kill_entry (entry=0x7f7749af35c0, file=<optimized out>, line=<optimized out>, function=<optimized out>)
    at /usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_helpers.c:1676
#5  0x00007f77480021d6 in shutdown_handles (fsal=0x7f7748341ea0 <MDCACHE>)
    at /usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/fsal_destroyer.c:66
#6  destroy_fsals () at /usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/fsal_destroyer.c:180
#7  0x00007f774802a28f in do_shutdown () at /usr/src/debug/nfs-ganesha-2.4.1/src/MainNFSD/nfs_admin_thread.c:446
#8  admin_thread (UnusedArg=<optimized out>) at /usr/src/debug/nfs-ganesha-2.4.1/src/MainNFSD/nfs_admin_thread.c:466
#9  0x00007f7746588dc5 in start_thread () from /lib64/libpthread.so.0
#10 0x00007f7745c5773d in clone () from /lib64/libc.so.6


Version-Release number of selected component (if applicable):
--------------------------------------------------------------

nfs-ganesha-2.4.1-5.el7rhgs.x86_64
nfs-ganesha-debuginfo-2.4.1-5.el7rhgs.x86_64
nfs-ganesha-gluster-2.4.1-5.el7rhgs.x86_64
glusterfs-ganesha-3.8.4-11.el7rhgs.x86_64


How reproducible:
------------------

Every time

Steps to Reproduce:
--------------------

Restart/Stop Ganesha service post setting up the cluster.

Actual results:
---------------

Ganesha crashes and dumps core.

Expected results:
-----------------

No crash.

Additional info:
-----------------

*Client and Server OS* : RHEL 7.3
Comment 3 Daniel Gryniewicz 2017-01-16 13:57:31 UTC 
This is a case of an extra ref taken or a failure to deref.  Where is the source that corresponds to nfs-ganesha-2.4.1-5.el7rhgs?  What is the workload that is being run?
Comment 7 Daniel Gryniewicz 2017-01-16 15:26:02 UTC 
Proposed fix: https://review.gerrithub.io/343263
Comment 10 Ambarish 2017-01-20 07:50:15 UTC 
The reported issue was not reproducible on Ganesha 2.4.1-6,Gluster 3.8.4-12.

Verified.
Comment 12 errata-xmlrpc 2017-03-23 06:28:52 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHEA-2017-0493.html