RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 1164064 - RHEL-7.1 regression fail: service nfs-idmapd start fail
Summary: RHEL-7.1 regression fail: service nfs-idmapd start fail
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Enterprise Linux 7
Classification: Red Hat
Component: nfs-utils
Version: 7.1
Hardware: All
OS: Linux
urgent
urgent
Target Milestone: rc
: ---
Assignee: Steve Dickson
QA Contact: Yongcheng Yang
URL:
Whiteboard:
: 1225315 (view as bug list)
Depends On:
Blocks: 1149911 1225315
TreeView+ depends on / blocked
 
Reported: 2014-11-14 03:07 UTC by JianHong Yin
Modified: 2018-12-28 09:18 UTC (History)
7 users (show)

Fixed In Version: nfs-utils-1.3.0-0.12.el7
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2015-11-19 04:28:24 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2015:2196 0 normal SHIPPED_LIVE nfs-utils bug fix update 2015-11-19 08:05:04 UTC

Description JianHong Yin 2014-11-14 03:07:54 UTC 
Description of problem:
RHEL-7.1 regression fail: service nfs-idmapd start fail
Nov 13 21:37:48 ibm-p8-04-lp8.rhts.eng.bos.redhat.com rpc.idmapd[14719]: main: open(/var/lib/nfs/rpc_pipefs//nfs): No such file or directory

Version-Release number of selected component (if applicable):
------------------------------------------------
Time & CURDIR : [2014-11-13 21:35:25 @/mnt/tests/CoreOS/nfs-utils/function/nfs-nis-idmap]
Case Name     : /CoreOS/nfs-utils/function/nfs-nis-idmap
$HOSTNAME     : ibm-p8-04-lp8.rhts.eng.bos.redhat.com
Distro Info   : RedHatEnterpriseServer 7.1 : RHEL-7.1-20141113.0
NVR & host    : Linux ibm-p8-04-lp8.rhts.eng.bos.redhat.com 3.10.0-201.el7.ppc64 #1 SMP Mon Nov 10 17:09:19 EST 2014 ppc64 ppc64 ppc64 GNU/Linux
cmdline       :
	BOOT_IMAGE=/vmlinuz-3.10.0-201.el7.ppc64 root=/dev/mapper/rhel_ibm--p8--04--lp8-root ro crashkernel=auto rd.lvm.lv=rhel_ibm-p8-04-lp8/swap rd.lvm.lv=rhel_ibm-p8-04-lp8/root LANG=en_US.UTF-8
Package Info  :
	libnfsidmap-0.25-11.el7.ppc64
	package libsss_idmap is not installed
	libtirpc-0.2.4-0.4.el7.ppc64
	nfs-utils-1.3.0-0.4.el7.ppc64
	package nfs-utils-lib is not installed
------------------------------------------------

How reproducible:
always

Steps to Reproduce:
1. install distro 7.1
2. run service nfs-idmapd restart    # try to start rpcidmapd
3. journalctl -xn  #check error log

Actual results:
[21:37:48 root@ ~~]# service_rpcidmapd restart
Redirecting to /bin/systemctl restart  nfs-idmapd.service
Job for nfs-idmapd.service failed. See 'systemctl status nfs-idmapd.service' and 'journalctl -xn' for details.

# journalctl -xn
-- Logs begin at Thu 2014-11-13 21:34:10 EST, end at Thu 2014-11-13 21:37:48 EST. --
Nov 13 21:36:09 ibm-p8-04-lp8.rhts.eng.bos.redhat.com systemd[1]: Started NIS/YP (Network Information Service) Clients to NIS Domain Binder.
-- Subject: Unit ypbind.service has finished start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit ypbind.service has finished starting up.
-- 
-- The start-up result is done.
Nov 13 21:36:10 ibm-p8-04-lp8.rhts.eng.bos.redhat.com logger[13890]: 2014-11-13 21:36:10 /usr/bin/rhts-test-runner.sh 2774 120 hearbeat...
Nov 13 21:37:10 ibm-p8-04-lp8.rhts.eng.bos.redhat.com logger[14366]: 2014-11-13 21:37:10 /usr/bin/rhts-test-runner.sh 2774 180 hearbeat...
Nov 13 21:37:48 ibm-p8-04-lp8.rhts.eng.bos.redhat.com systemd[1]: Starting Preprocess NFS configuration...
-- Subject: Unit nfs-config.service has begun with start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit nfs-config.service has begun starting up.
Nov 13 21:37:48 ibm-p8-04-lp8.rhts.eng.bos.redhat.com systemd[1]: Started Preprocess NFS configuration.
-- Subject: Unit nfs-config.service has finished start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit nfs-config.service has finished starting up.
-- 
-- The start-up result is done.
Nov 13 21:37:48 ibm-p8-04-lp8.rhts.eng.bos.redhat.com systemd[1]: Starting NFSv4 ID-name mapping service...
-- Subject: Unit nfs-idmapd.service has begun with start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit nfs-idmapd.service has begun starting up.
Nov 13 21:37:48 ibm-p8-04-lp8.rhts.eng.bos.redhat.com rpc.idmapd[14719]: main: open(/var/lib/nfs/rpc_pipefs//nfs): No such file or directory
Nov 13 21:37:48 ibm-p8-04-lp8.rhts.eng.bos.redhat.com systemd[1]: nfs-idmapd.service: control process exited, code=exited status=1
Nov 13 21:37:48 ibm-p8-04-lp8.rhts.eng.bos.redhat.com systemd[1]: Failed to start NFSv4 ID-name mapping service.
-- Subject: Unit nfs-idmapd.service has failed
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit nfs-idmapd.service has failed.
-- 
-- The result is failed.
Nov 13 21:37:48 ibm-p8-04-lp8.rhts.eng.bos.redhat.com systemd[1]: Unit nfs-idmapd.service entered failed state.
:: [   FAIL   ] :: Running 'service_rpcidmapd restart' (Expected 0, got 1)

Expected results:
should start OK

Additional info:
    works fine in RHEL-7.0
Comment 4 Steve Dickson 2014-12-04 17:15:16 UTC 
This works for me
rhel7# systemctl restart nfs-idmapd
rhel7# systemctl status nfs-idmapd
nfs-idmapd.service - NFSv4 ID-name mapping service
   Loaded: loaded (/usr/lib/systemd/system/nfs-idmapd.service; static)
   Active: active (running) since Thu 2014-12-04 12:14:46 EST; 4s ago
  Process: 3241 ExecStart=/usr/sbin/rpc.idmapd $RPCIDMAPDARGS (code=exited, status=0/SUCCESS)
 Main PID: 3242 (rpc.idmapd)
   CGroup: /system.slice/nfs-idmapd.service
           `-3242 /usr/sbin/rpc.idmapd

Dec 04 12:14:46 rhel7.boston.devel.redhat.com systemd[1]: Started NFSv4 ID-na...
Hint: Some lines were ellipsized, use -l to show in full.
Comment 9 Steve Dickson 2014-12-15 17:17:15 UTC 
Also there is no longer a need to start the nfs-idmapd service explicitly.
The daemon is automatically started by the nfs-server service.
Comment 10 JianHong Yin 2015-01-07 09:12:37 UTC 
Always fail in our test cases;

** But works fine in RHEL-7.0 released 

[16:48:52 root@ ~~]# grep "^[^#]" /etc/idmapd.conf
[General]
Verbosity = 2
Domain = 
[Mapping]
[Translation]
 
[Static]
[UMICH_SCHEMA]
LDAP_server = ldap-server.local.domain.edu
LDAP_base = dc=local,dc=domain,dc=edu
:: [   PASS   ] :: Running 'grep "^[^#]" /etc/idmapd.conf' (Expected 0, got 0)
--------------------------------------------------------------------------------
[16:48:52 root@ ~~]# service_rpcidmapd restart
Redirecting to /bin/systemctl restart  nfs-idmapd.service
Job for nfs-idmapd.service failed. See 'systemctl status nfs-idmapd.service' and 'journalctl -xn' for details.
-- Logs begin at Wed 2015-01-07 16:44:18 CST, end at Wed 2015-01-07 16:48:52 CST. --
Jan 07 16:48:52 ibm-x3250m4-06.rhts.eng.nay.redhat.com rpc.idmapd[13099]: rpc.idmapd: libnfsidmap: Realms list: ''
Jan 07 16:48:52 ibm-x3250m4-06.rhts.eng.nay.redhat.com rpc.idmapd[13099]: libnfsidmap: loaded plugin /lib64/libnfsidmap/nsswitch.so for method nsswitch
Jan 07 16:48:52 ibm-x3250m4-06.rhts.eng.nay.redhat.com rpc.idmapd[13099]: rpc.idmapd: libnfsidmap: loaded plugin /lib64/libnfsidmap/nsswitch.so for method nsswitch
Jan 07 16:48:52 ibm-x3250m4-06.rhts.eng.nay.redhat.com rpc.idmapd[13100]: Expiration time is 600 seconds.
Jan 07 16:48:52 ibm-x3250m4-06.rhts.eng.nay.redhat.com rpc.idmapd[13100]: Opened /proc/net/rpc/nfs4.nametoid/channel
Jan 07 16:48:52 ibm-x3250m4-06.rhts.eng.nay.redhat.com rpc.idmapd[13100]: Opened /proc/net/rpc/nfs4.idtoname/channel
Jan 07 16:48:52 ibm-x3250m4-06.rhts.eng.nay.redhat.com rpc.idmapd[13100]: main: open(/var/lib/nfs/rpc_pipefs//nfs): No such file or directory
Jan 07 16:48:52 ibm-x3250m4-06.rhts.eng.nay.redhat.com systemd[1]: nfs-idmapd.service: control process exited, code=exited status=1
Jan 07 16:48:52 ibm-x3250m4-06.rhts.eng.nay.redhat.com systemd[1]: Failed to start NFSv4 ID-name mapping service.
-- Subject: Unit nfs-idmapd.service has failed
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit nfs-idmapd.service has failed.
-- 
-- The result is failed.
Jan 07 16:48:52 ibm-x3250m4-06.rhts.eng.nay.redhat.com systemd[1]: Unit nfs-idmapd.service entered failed state.
:: [   FAIL   ] :: Running 'service_rpcidmapd restart' (Expected 0, got 1)
Comment 11 JianHong Yin 2015-01-07 09:14:31 UTC 
Test in RHEL-7.0 works fine:

[16:52:21 root@ ~~]# grep "^[^#]" /etc/idmapd.conf
[General]
Verbosity = 2
Domain = 
[Mapping]
[Translation]
 
[Static]
[UMICH_SCHEMA]
LDAP_server = ldap-server.local.domain.edu
LDAP_base = dc=local,dc=domain,dc=edu
:: [   PASS   ] :: Running 'grep "^[^#]" /etc/idmapd.conf' (Expected 0, got 0)
--------------------------------------------------------------------------------
[16:52:22 root@ ~~]# service_rpcidmapd restart
Redirecting to /bin/systemctl restart  rpcidmapd.service
:: [   PASS   ] :: Running 'service_rpcidmapd restart' (Expected 0, got 0)
Comment 12 Steve Dickson 2015-01-07 17:07:14 UTC 
(In reply to Yin.JianHong from comment #11)
> Test in RHEL-7.0 works fine:
> 
In RHEL7.1 rpc.idmapd is nolonger explicitly started.

It is started by the nfs-service service. So this
test is no longer valid IMHO...
Comment 13 JianHong Yin 2015-01-28 02:19:57 UTC 
Test PASS in latest nfs-utils-1.3.0-0.8.el7:

https://beaker.engineering.redhat.com/recipes/1781553#task27613346
[23:10:44 root@ ~~]# service_rpcidmapd restart
Redirecting to /bin/systemctl restart  nfs-idmapd.service
:: [   PASS   ] :: Running 'service_rpcidmapd restart' (Expected 0, got 0)
--------------------------------------------------------------------------------


So change the WONTFIX to CURRENTRELEASE.
Comment 14 Kurt Miller 2015-06-02 18:04:42 UTC 
We still see rpc.idmapd failing to start on 7.1 on some boot ups when the timing is right. It fails with the same error:

Jun 02 13:59:15 lvmtest rpc.idmapd[17193]: main: open(/var/lib/nfs/rpc_pipefs//nfs): No such file or directory

This is because the systemd service file for rpc.idmapd doesn't depend on the /var/lib/nfs/rpc_pipefs mount. In 7.1 the service file looks like this:

cat /usr/lib/systemd/system/nfs-idmapd.service
[Unit]
Description=NFSv4 ID-name mapping service

BindsTo=nfs-server.service

Wants=nfs-config.service
After=nfs-config.service

[Service]
EnvironmentFile=-/run/sysconfig/nfs-utils
Type=forking
ExecStart=/usr/sbin/rpc.idmapd $RPCIDMAPDARGS

It should look like this so that it waits for the rpc_pipefs mount:
[Unit]
Description=NFSv4 ID-name mapping service

BindsTo=nfs-server.service

Wants=nfs-config.service
Requires=var-lib-nfs-rpc_pipefs.mount 
After=nfs-config.service var-lib-nfs-rpc_pipefs.mount 

[Service]
EnvironmentFile=-/run/sysconfig/nfs-utils
Type=forking
ExecStart=/usr/sbin/rpc.idmapd $RPCIDMAPDARGS

Note the addition of 'Requires' and 'After' on var-lib-nfs-rpc_pipefs.mount. This is needed to ensure the race condition goes away on start-up.

The proper way to reproduce the problem is as follows:

systemctl stop nfs-idmapd
systemctl stop var-lib-nfs-rpc_pipefs.mount
systemctl start nfs-idmapd
Job for nfs-idmapd.service failed. See 'systemctl status nfs-idmapd.service' and 'journalctl -xn' for details.

With the correction to the service file for nfs-idmapd I proposed the above test works.

Please reopen this bug and correct the service file for nfs-idmapd.
Comment 15 JianHong Yin 2015-06-23 02:33:39 UTC 
Thanks Kurt Miller.

According Comment 14 , reopen this bug.
Hi steved, how do you think about comment 14.
Comment 16 Steve Dickson 2015-06-23 18:45:11 UTC 
(In reply to Yin.JianHong from comment #15)
> Thanks Kurt Miller.
> 
> According Comment 14 , reopen this bug.
> Hi steved, how do you think about comment 14.

We fix the bug with this commit:

commit 6efdb0440daf3ed304a3c1115f01e76e89d792a7
Author: Chris Mayo <aklhfex>
Date:   Fri Jan 23 10:35:32 2015 -0500

    systemd: Ensure RPC pipefs is mounted before rpc.idmapd starts
    
    rpc.idmapd aborts on start-up if RPC pipefs is not present.
    
    Needed if GSS services are not used.
    
    Signed-off-by: Chris Mayo <aklhfex>
    Signed-off-by: Steve Dickson <steved>
Comment 18 Kurt Miller 2015-06-24 13:34:03 UTC 
Thanks for fixing this.
Comment 20 Kosuke TATSUKAWA 2015-07-30 23:25:43 UTC 
*** Bug 1225315 has been marked as a duplicate of this bug. ***
Comment 21 Yongcheng Yang 2015-07-31 09:12:51 UTC 
Verified with nfs-utils-1.3.0-0.13.el7.x86_64

[root@hp-dl385pg8-03 ~]# systemctl stop nfs-idmapd
[root@hp-dl385pg8-03 ~]# systemctl stop var-lib-nfs-rpc_pipefs.mount
[root@hp-dl385pg8-03 ~]# systemctl start nfs-idmapd
[root@hp-dl385pg8-03 ~]# echo $?
0
[root@hp-dl385pg8-03 ~]# systemctl status nfs-idmapd
● nfs-idmapd.service - NFSv4 ID-name mapping service
   Loaded: loaded (/usr/lib/systemd/system/nfs-idmapd.service; static; vendor preset: disabled)
   Active: active (running) since Fri 2015-07-31 17:11:33 CST; 12s ago
  Process: 679 ExecStart=/usr/sbin/rpc.idmapd $RPCIDMAPDARGS (code=exited, status=0/SUCCESS)
 Main PID: 680 (rpc.idmapd)
   CGroup: /system.slice/nfs-idmapd.service
           └─680 /usr/sbin/rpc.idmapd

Jul 31 17:11:33 hp-dl385pg8-03.rhts.eng.nay.redhat.com systemd[1]: Starting NFSv4 ID-name mapping service...
Jul 31 17:11:33 hp-dl385pg8-03.rhts.eng.nay.redhat.com systemd[1]: Started NFSv4 ID-name mapping service.
[root@hp-dl385pg8-03 ~]# rpm -q nfs-utils
nfs-utils-1.3.0-0.13.el7.x86_64
[root@hp-dl385pg8-03 ~]# 

Move to VERIFIED
Comment 22 Lukas Zapletal 2015-09-03 08:39:58 UTC 
Is there an official document showing NFS changes between 7.0 and 7.1 releases? It looks there are many 7.0 "tutorials" out there but most of them have incorrect service names for 7.1. Thanks!
Comment 23 errata-xmlrpc 2015-11-19 04:28:24 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHBA-2015-2196.html
Note You need to log in before you can comment on or make changes to this bug.