Bug 1474716

Summary: [Ganesha]When all the nodes are rebooted, ganesha service fails to come up on few even when shared_storage is mounted
Product: [Red Hat Storage] Red Hat Gluster Storage Reporter: Manisha Saini <msaini>
Component: nfs-ganeshaAssignee: Kaleb KEITHLEY <kkeithle>
Status: CLOSED WONTFIX QA Contact: Manisha Saini <msaini>
Severity: medium Docs Contact:
Priority: unspecified    
Version: rhgs-3.3CC: amukherj, arjsharm, dang, jthottan, kkeithle, pasik, pmulay, rcyriac, rhs-bugs, skoduri, storage-qa-internal
Target Milestone: ---Keywords: Triaged, ZStream
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Known Issue
Doc Text:
After a reboot, systemd may interpret NFS-Ganesha to be in STARTED state when it is not running. Workaround: Manually start the NFS-Ganesha process.
 Story Points: ---
Clone Of: Environment:
Last Closed: 2019-05-20 12:41:29 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1417153    

Description Manisha Saini 2017-07-25 09:01:25 UTC 
Description of problem:

While verifying bug #1451981 ,as mentioned in comment #13,Observed..ganesha service goes to failed state on few nodes after reboot.



Version-Release number of selected component (if applicable):

# rpm -qa | grep ganesha
nfs-ganesha-gluster-2.4.4-16.el7rhgs.x86_64
glusterfs-ganesha-3.8.4-34.el7rhgs.x86_64
nfs-ganesha-2.4.4-16.el7rhgs.x86_64


How reproducible:


Steps to Reproduce:
1.Create 6 node ganesha cluster.
2.Reboot all the nodes


Actual results:
When nodes come up,on few nodes Ganesha service goes to failed state.

Expected results:
Ganesha service should start on all the nodes after reboot.

Additional info:

systemctl status nfs-ganesha
● nfs-ganesha.service - NFS-Ganesha file server
   Loaded: loaded (/usr/lib/systemd/system/nfs-ganesha.service; enabled; vendor preset: disabled)
   Active: inactive (dead) since Thu 2017-07-20 12:16:16 IST; 2h 28min ago
     Docs: http://github.com/nfs-ganesha/nfs-ganesha/wiki
 Main PID: 2341 (code=exited, status=2)

Jul 20 12:16:16 dhcp42-127.lab.eng.blr.redhat.com systemd[1]: Starting NFS-Ganesha file server...
Jul 20 12:16:16 dhcp42-127.lab.eng.blr.redhat.com bash[2429]: prlimit: invalid PID argument: '--nofile=1048576:1048576'
Jul 20 12:16:16 dhcp42-127.lab.eng.blr.redhat.com systemd[1]: Started NFS-Ganesha file server.

Even though nfs-ganesha didn't start properly, but systemd consider it to be started.
Comment 2 Daniel Gryniewicz 2017-07-25 12:23:24 UTC 
Is there a ganesha log somewhere?
Comment 5 Jiffin 2017-07-27 12:29:52 UTC 
(In reply to Daniel Gryniewicz from comment #2)
> Is there a ganesha log somewhere?

Here ganesha service was not at started because ganesha.conf was not available(for gluster we store ganesha.conf in shared volume). But by somehow systemd interupts it to be started and stopping restarting ganesha service after reboot
Comment 7 Jiffin 2017-08-17 05:09:33 UTC 
Doc text looks good to me