Bugzilla will be upgraded to version 5.0 on a still to be determined date in the near future. The original upgrade date has been delayed.
Bug 613437 - RDMA/OpenIB shutdown hangs if using NFSoRDMA
RDMA/OpenIB shutdown hangs if using NFSoRDMA
Product: Fedora
Classification: Fedora
Component: rdma (Show other bugs)
All Linux
low Severity medium
: ---
: ---
Assigned To: Doug Ledford
Fedora Extras Quality Assurance
Depends On:
  Show dependency treegraph
Reported: 2010-07-11 11:32 EDT by David Dillow
Modified: 2011-05-02 12:49 EDT (History)
1 user (show)

See Also:
Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of:
Last Closed: 2011-05-02 12:49:47 EDT
Type: ---
Regression: ---
Mount Type: ---
Documentation: ---
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---

Attachments (Terms of Use)
Patch to shut down and unload NFSoRDMA modules during RDMA stop (1.03 KB, patch)
2010-07-11 11:32 EDT, David Dillow
no flags Details | Diff

  None (edit)
Description David Dillow 2010-07-11 11:32:02 EDT
Created attachment 431006 [details]
Patch to shut down and unload NFSoRDMA modules during RDMA stop

Description of problem:
If using NFSoRDMA, the reboot will hang while trying to stop the rdma service. This is due to not unloading the modules for NFSoRDMA prior to trying to unload the rest of the stack. It doesn't matter if the use of NFSoRDMA is as a client or as a server.

Version-Release number of selected component (if applicable):

How reproducible:

The attached patch fixes this issue for me during shutdown.
Comment 1 David Dillow 2010-07-11 12:27:31 EDT
Well, it is a partial fix -- I thought I had tested the patch with clients mounted, but it appears I did not. In that case, I still get the hangs, as svcrdma/xprtrdma do not unload.

So, more work to be done here.
Comment 2 Doug Ledford 2010-08-03 01:01:46 EDT
I'm creating a new service, nfs-rdma, that's intended to be started after nfs
and stopped before nfs that enables and disables rdma support.  The rdma init
script now checks to make sure that nfs-rdma support is disabled before downing
the rdma service.  If the nfs-rdma service fails to stop (because things are in
use) then you can down the nfs service and then down the nfs-rdma service
(which is backward order, but should work as downing the nfs service will free
up the kernel modules to be unloaded).  Will be present in rdma-1.0-8 or later.
Comment 3 David Dillow 2010-08-03 10:30:43 EDT
That will let me remove my modifications to get NFSoRDMA starting, but I don't think it is going to help when stopping the rdma service -- I've looked around a bit, but I don't see a way to forcibly disconnect clients from the NFS server, which keeps the use count non-zero on the nfsd and svcrdma modules, preventing their removal. There may be a way; I just haven't found it yet -- or it may be a different issue than I think.

I've also seen a similar problem with the NFS client, as even after unmounting all of the NFS filesystems, I still cannot rmmod xprtrdma.

I'm starting to wonder if the best workaround at the moment is to see if the scripts can detect we're going to runlevel 0, 1, or 6 and just not try to remove the modules.
Comment 4 Doug Ledford 2011-05-02 12:49:47 EDT
Fixed long ago but bug was not autoclosed.

Note You need to log in before you can comment on or make changes to this bug.