Bug 1241436 - nfs-ganesha: refresh-config stdout output includes dbus messages "method return sender=:1.61 -> dest=:1.65 reply_serial=2"
Summary: nfs-ganesha: refresh-config stdout output includes dbus messages "method retu...
Keywords:
Status: CLOSED ERRATA
Alias: None
Deadline: 2015-08-28
Product: Red Hat Gluster Storage
Classification: Red Hat Storage
Component: nfs-ganesha
Version: rhgs-3.1
Hardware: x86_64
OS: Linux
unspecified
medium
Target Milestone: ---
: RHGS 3.1.2
Assignee: Kaleb KEITHLEY
QA Contact: Matt Zywusko
URL:
Whiteboard:
Depends On:
Blocks: 1216951 1256227 1260783 1262881
TreeView+ depends on / blocked
 
Reported: 2015-07-09 08:53 UTC by Saurabh
Modified: 2016-03-01 05:28 UTC (History)
10 users (show)

Fixed In Version: glusterfs-3.7.5-6
Doc Type: Bug Fix
Doc Text:
Previously, in NFS-Ganesha, the refresh-config stdout output included dbus messages that were irrelevant. With this fix, the output of the refresh-config option is meaningful.
Clone Of:
: 1262881 (view as bug list)
Environment:
Last Closed: 2016-03-01 05:28:54 UTC
Embargoed:


Attachments (Terms of Use)
nfs12 ganesha.log (8.63 KB, text/plain)
2015-10-26 10:27 UTC, Saurabh
no flags Details
nfs12 ganesha-gfapi.log (645.61 KB, text/plain)
2015-10-26 10:28 UTC, Saurabh
no flags Details
nfs12 messages (79.43 KB, text/plain)
2015-10-26 10:29 UTC, Saurabh
no flags Details
nfs11 ganesha.log (7.95 KB, text/plain)
2015-10-26 10:32 UTC, Saurabh
no flags Details
nfs11 messages (205.94 KB, text/plain)
2015-10-26 10:40 UTC, Saurabh
no flags Details
nfs11 ganesha-gfapi.log (14.36 MB, application/x-xz)
2015-10-26 10:51 UTC, Saurabh
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2016:0193 0 normal SHIPPED_LIVE Red Hat Gluster Storage 3.1 update 2 2016-03-01 10:20:36 UTC

Description Saurabh 2015-07-09 08:53:09 UTC
Description of problem:
Update the export file of volume, execute refresh-config as this command helps to update the export file of volume on all nodes and update the nfs-ganesha process on all nodes.

Version-Release number of selected component (if applicable):
glusterfs-3.7.1-8.el6rhs.x86_64
nfs-ganesha-2.2.0-4.el6rhs.x86_64

How reproducible:
always

Steps to Reproduce:
1. export a volume using the ganesha.enable
2. change export file of the volume for setting root_squash on
3. execute refresh-config from same node

Actual results:
[root@nfs11 ~]# time bash /usr/libexec/ganesha/ganesha-ha.sh --refresh-config /etc/ganesha/ vol3
export.vol3.conf                                                                                                                                                             100%  503     0.5KB/s   00:00    
method return sender=:1.61 -> dest=:1.65 reply_serial=2
export.vol3.conf                                                                                                                                                             100%  503     0.5KB/s   00:00    
method return sender=:1.62 -> dest=:1.66 reply_serial=2
export.vol3.conf                                                                                                                                                             100%  503     0.5KB/s   00:00    
method return sender=:1.62 -> dest=:1.66 reply_serial=2
method return sender=:1.71 -> dest=:1.75 reply_serial=2

Expected results:
dbus messages should not seen on stdout or they should be made more meaningful

Additional info:

Comment 3 monti lawrence 2015-07-22 20:00:37 UTC
Doc text is edited. Please sign off to be included in Known Issues.

Comment 4 Anjana Suparna Sriram 2015-07-27 18:39:25 UTC
Included the edited text as known issue.

Comment 13 Saurabh 2015-10-26 06:27:21 UTC
Presently refresh config fails,

time /usr/libexec/ganesha/ganesha-ha.sh --refresh-config /etc/ganesha/ testvol
Error: refresh-config failed on nfs12.

just for fyi,
the passwordless connections are in place,

i = [nfs11 nfs12 nfs13 nfs15]
ssh -i /var/lib/glusterd/nfs/secret.pem  $i "hostname"
nfs11
nfs11
------------
nfs12
nfs12
------------
nfs13
nfs13
------------
nfs15
nfs15
------------

Comment 14 Soumya Koduri 2015-10-26 08:49:16 UTC
Please provide the error messages logged (/var/log/messages, /var/log/ganesha.log, /var/log/ganesha-gfapi.log) when this issue is seen.

Comment 16 Saurabh 2015-10-26 10:27:43 UTC
Created attachment 1086455 [details]
nfs12 ganesha.log

Comment 17 Saurabh 2015-10-26 10:28:32 UTC
Created attachment 1086456 [details]
nfs12 ganesha-gfapi.log

Comment 18 Saurabh 2015-10-26 10:29:01 UTC
Created attachment 1086457 [details]
nfs12 messages

Comment 20 Saurabh 2015-10-26 10:32:15 UTC
Created attachment 1086458 [details]
nfs11 ganesha.log

Comment 21 Saurabh 2015-10-26 10:40:30 UTC
Created attachment 1086460 [details]
nfs11 messages

Comment 22 Saurabh 2015-10-26 10:51:54 UTC
Created attachment 1086462 [details]
nfs11 ganesha-gfapi.log

Comment 23 Soumya Koduri 2015-10-28 06:43:02 UTC
On nfs12-

26/10/2015 16:56:37 : epoch 562e0dec : nfs12 : ganesha.nfsd-27481[main] nfs_Start_threads :THREAD :EVENT :reaper thread was started successfully
26/10/2015 16:56:37 : epoch 562e0dec : nfs12 : ganesha.nfsd-27481[reaper] nfs_in_grace :STATE :EVENT :NFS Server Now IN GRACE
26/10/2015 16:56:37 : epoch 562e0dec : nfs12 : ganesha.nfsd-27481[main] nfs_Start_threads :THREAD :EVENT :General fridge was started successfully
26/10/2015 16:56:37 : epoch 562e0dec : nfs12 : ganesha.nfsd-27481[main] nfs_start :NFS STARTUP :EVENT :-------------------------------------------------
26/10/2015 16:56:37 : epoch 562e0dec : nfs12 : ganesha.nfsd-27481[main] nfs_start :NFS STARTUP :EVENT :             NFS SERVER INITIALIZED
26/10/2015 16:56:37 : epoch 562e0dec : nfs12 : ganesha.nfsd-27481[main] nfs_start :NFS STARTUP :EVENT :-------------------------------------------------
26/10/2015 16:57:37 : epoch 562e0dec : nfs12 : ganesha.nfsd-27481[reaper] nfs_in_grace :STATE :EVENT :NFS Server Now NOT IN GRACE
26/10/2015 17:02:43 : epoch 562e0dec : nfs12 : ganesha.nfsd-27481[dbus_heartbeat] glusterfs_create_export :FSAL :EVENT :Volume testvol exported at : '/'
26/10/2015 17:37:32 : epoch 562e0dec : nfs12 : ganesha.nfsd-27481[dbus_heartbeat] dbus_message_entrypoint :DBUS :MAJ :Method (RemoveExport) on (org.ganesha.nfsd.exportmgr) failed: name = (org.freedesktop.DBus.Error.InvalidArgs), message = (lookup_export failed with Export id not found)
26/10/2015 17:37:43 : epoch 562e0dec : nfs12 : ganesha.nfsd-27481[dbus_heartbeat] glusterfs_create_export :FSAL :EVENT :Volume testvol exported at : '



Looks like volume testvol is exported with a different ExportID on nfs12. May be a configuration issue. Request QE to reproduce/provide setup to debug further.

Comment 24 Soumya Koduri 2015-10-28 09:28:35 UTC
Got the setup from QE. There is an issue with output parsing in ganesha-ha.sh script. Posted the fix upstream for review -
http://review.gluster.org/#/c/12439/

Comment 25 Kaleb KEITHLEY 2015-11-05 14:10:55 UTC
included in the 3.1.2 rebase

Comment 26 Soumya Koduri 2015-11-06 06:03:36 UTC
I think it has failed QA test with the latest 3.1.2 rebase code.

Saurabh, could you please confirm?

Comment 28 Saurabh 2015-11-18 08:27:43 UTC
As per result,
# time bash /usr/libexec/ganesha/ganesha-ha.sh --refresh-config /etc/ganesha/ vol0
Refresh-config completed on vm2.
Refresh-config completed on vm3.
Refresh-config completed on vm4.
Success: refresh-config completed.

Comment 32 errata-xmlrpc 2016-03-01 05:28:54 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHBA-2016-0193.html


Note You need to log in before you can comment on or make changes to this bug.