RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 1762847 - RHEL8: rpc.gssd crashes when gssproxy is used and the RPCSEC_GSS library debug is enabled
Summary: RHEL8: rpc.gssd crashes when gssproxy is used and the RPCSEC_GSS library debu...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Enterprise Linux 8
Classification: Red Hat
Component: nfs-utils
Version: 8.0
Hardware: Unspecified
OS: Linux
unspecified
medium
Target Milestone: rc
: 8.2
Assignee: Steve Dickson
QA Contact: Yongcheng Yang
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2019-10-17 16:12 UTC by Jacob Shivers
Modified: 2020-04-28 16:51 UTC (History)
4 users (show)

Fixed In Version: nfs-utils-2.3.3-28.el8
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2020-04-28 16:51:05 UTC
Type: Bug
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2020:1832 0 None None None 2020-04-28 16:51:25 UTC

Description Jacob Shivers 2019-10-17 16:12:03 UTC 
This bug was initially created as a copy of Bug #1645083

I am copying this bug because: this behavior also applies to RHEL 8/8.1



Description of problem:
When using rpc.gssd in combination with gssproxy, rpc.gssd may misbehave 
and crash.

Version-Release number of selected component (if applicable):
nfs-utils-1.3.0-0.61.el7.x86_64
kernel-3.10.0-957.el7.x86_64

How reproducible:
Always in this specific configuration.

Steps to Reproduce:

1. Export the NFS client/server keytabs from a AD domain controller
2. Set up a NFS client and a NFS server with the right keytabs 
3. Export from the NFS server a krb5 share
4. Try to mount on the NFS client the share

Actual results:
mount.nfs: an incorrect mount option was specified

Expected results:
It should work.

Additional info:
Removing gssproxy from the equation makes rpc.gssd to work, but from the debug logs it seems gssproxy just handle the data to rpc.gssd which crashes.
Note the same issue happens on RHEL 7.5 too (I didn't test older versions).
Comment 1 Jacob Shivers 2019-10-17 16:15:33 UTC 
I can confirm that this crash behavior is also present in RHEL8:

# mount ad-nfs-server.example.net:/secure /mnt/secure/ -o sec=krb5,vers=4.1
mount.nfs: access denied by server while mounting ad-nfs-server.example.net:/secure
[root@rhel-80 ~]
# systemctl status rpc-gssd
● rpc-gssd.service - RPC security service for NFS client and server
   Loaded: loaded (/usr/lib/systemd/system/rpc-gssd.service; bad; vendor preset: disabled)
   Active: failed (Result: exit-code) since Mon 2019-10-14 11:48:42 EDT; 5s ago
  Process: 1438 ExecStart=/usr/sbin/rpc.gssd -r (code=exited, status=0/SUCCESS)
 Main PID: 1440 (code=exited, status=1/FAILURE)

Oct 14 11:48:15 rhel-80.example.net systemd[1]: Stopped RPC security service for NFS client and server.
Oct 14 11:48:15 rhel-80.example.net systemd[1]: Starting RPC security service for NFS client and server...
Oct 14 11:48:15 rhel-80.example.net rpc.gssd[1438]: libtirpc: debug level 1
Oct 14 11:48:15 rhel-80.example.net systemd[1]: Started RPC security service for NFS client and server.
Oct 14 11:48:42 rhel-80.example.net systemd[1]: rpc-gssd.service: Main process exited, code=exited, status=1/FAILURE
Oct 14 11:48:42 rhel-80.example.net systemd[1]: rpc-gssd.service: Failed with result 'exit-code'.


On a side-note, there is not a facility to adjust/enable rpc.gssd arguments in /etc/nfsmount.conf comparable to what was present in /etc/sysconfig/nfs.
Unless I am missing something, it is required to edit the systemd unit file to enable debugging/increased verbosity.

This behavior is also reproducible in the RHEL 8.1 beta.
Comment 3 Dave Wysochanski 2019-11-25 20:12:34 UTC 
Steve is this on your radar screen?  Support needs this in rhel8 otherwise it will be very difficult to troubleshoot rpc.gssd issues.

I just ran into this when testing https://bugzilla.redhat.com/show_bug.cgi?id=1776067 but it was not material to my troubleshooting of that problem.
Comment 4 Dave Wysochanski 2019-11-25 20:13:07 UTC 
This does not require AD to reproduce.
Comment 5 Steve Dickson 2019-11-26 18:57:38 UTC 
(In reply to Dave Wysochanski from comment #3)
> Steve is this on your radar screen?  Support needs this in rhel8 otherwise
> it will be very difficult to troubleshoot rpc.gssd issues.
> 
> I just ran into this when testing
> https://bugzilla.redhat.com/show_bug.cgi?id=1776067 but it was not material
> to my troubleshooting of that problem.

It is now... :-)
Comment 7 Yongcheng Yang 2019-11-27 07:13:56 UTC 
Verified in nfs-utils-2.3.3-28.el8
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
https://beaker.engineering.redhat.com/recipes/7622339#task102805589
-------------------------------------------------------------------
[01:14:17 root@ ~~]# cat /etc/nfs.conf
[gssd]
 use-gss-proxy=yes
 verbosity=3
 rpc-verbosity=3     <<<<<<<<<<<<<<
[01:14:17 root@ ~~]# service_rpcgssd restart
Redirecting to /bin/systemctl restart rpc-gssd.service
[01:14:17 root@ ~~]# service_rpcgssd status
Redirecting to /bin/systemctl status rpc-gssd.service
* rpc-gssd.service - RPC security service for NFS client and server
   Loaded: loaded (/usr/lib/systemd/system/rpc-gssd.service; static; vendor preset: disabled)
   Active: active (running) since Wed 2019-11-27 01:14:17 EST; 50ms ago
  Process: 8554 ExecStart=/usr/sbin/rpc.gssd (code=exited, status=0/SUCCESS)
 Main PID: 8555 (rpc.gssd)
    Tasks: 1 (limit: 23978)
   Memory: 856.0K
   CGroup: /system.slice/rpc-gssd.service
           `-8555 /usr/sbin/rpc.gssd

Nov 27 01:14:17 rhel-8.2.redhat.com systemd[1]: Starting RPC security service for NFS client and server...
Nov 27 01:14:17 rhel-8.2.redhat.com rpc.gssd[8554]: libtirpc: debug level 3
Nov 27 01:14:17 rhel-8.2.redhat.com rpc.gssd[8555]: doing a full rescan
Nov 27 01:14:17 rhel-8.2.redhat.com systemd[1]: Started RPC security service for NFS client and server.
[01:14:18 root@ ~~]# mount -t nfs4 -o sec=krb5 rhel-8.2.redhat.com:/exportDir-krb5-common-local /mnt/nfsmp-krb5-common-local
[01:14:18 root@ ~~]# cat /proc/mounts | grep /mnt/nfsmp-krb5-common-local
rhel-8.2.redhat.com:/exportDir-krb5-common-local /mnt/nfsmp-krb5-common-local nfs4 rw,relatime,vers=4.2,rsize=524288,wsize=524288,namlen=255,hard,proto=tcp6,timeo=600,retrans=2,sec=krb5,clientaddr=2620:52:0:1038:5054:ff:fef0:94af,local_lock=none,addr=2620:52:0:1038:5054:ff:fef0:94af 0 0
[01:14:18 root@ ~~]# umount /mnt/nfsmp-krb5-common-local


Compared with previous 2.3.3-27.el8
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
https://beaker.engineering.redhat.com/recipes/7622340#task102805592
...
[07:43:05 root@ ~~]# mount -t nfs4 -o sec=krb5 kvm-02-guest02.rhts.eng.brq.redhat.com:/exportDir-krb5-common-local /mnt/nfsmp-krb5-common-local
mount.nfs4: an incorrect mount option was specified
Comment 9 errata-xmlrpc 2020-04-28 16:51:05 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:1832
Note You need to log in before you can comment on or make changes to this bug.