Bug 508871 - [Emulex 5.4 bug] Unload of bonding driver causes be2net driver to deadlock
Summary: [Emulex 5.4 bug] Unload of bonding driver causes be2net driver to deadlock
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Enterprise Linux 5
Classification: Red Hat
Component: kernel
Version: 5.4
Hardware: All
OS: Linux
high
high
Target Milestone: rc
: 5.4
Assignee: Andy Gospodarek
QA Contact: Red Hat Kernel QE team
URL:
Whiteboard:
Depends On: 490074 508839
Blocks: 461676
TreeView+ depends on / blocked
 
Reported: 2009-06-30 11:17 UTC by Subbu Seetharaman
Modified: 2013-09-16 06:09 UTC (History)
15 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2009-09-02 08:15:23 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)
patch to fix deadlock seen when rmmoding bonding driver (44.89 KB, patch)
2009-06-30 17:02 UTC, Subbu Seetharaman
no flags Details | Diff


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHSA-2009:1243 0 normal SHIPPED_LIVE Important: Red Hat Enterprise Linux 5.4 kernel security and bug fix update 2009-09-01 08:53:34 UTC

Description Subbu Seetharaman 2009-06-30 11:17:05 UTC
Description of problem:

A test that repeatedly loads bonding driver, enslaves a be2net interface and unloads the bonding driver will result in a system freeze.

How reproducible:

One out of 10 attempts to load and unload bonding driver with a be2net interface as slave.

Steps to Reproduce:

Run the following commands in a loop :

rmmod bonding
modprobe bonding miimon=100
echo 4 > /sys/class/net/bond0/bonding/mode
ifconfig bond0 <IP-ADDR>netmask 255.0.0.0
ifenslave bond0 eth2 eth3
ping -q -c 10 -w 10 <IP-ADDR-OF-PEER>
  
Actual results:

System will lock up in couple of minutes.

Expected results:

The test must continue without any problem.

Comment 2 Andy Gospodarek 2009-06-30 13:32:53 UTC
Subbu, do you have any additional information for this problem?  Backtraces, patches, etc?

I would like to help with this, but I will not have the ability to use my card for a day or two so I cannot test this.

Comment 3 Subbu Seetharaman 2009-06-30 13:42:52 UTC
The problem is understood and fixed.  Fix has been tested and pushed upstream.  I will shortly be attaching the patch.

Subbu

Comment 4 Andy Gospodarek 2009-06-30 14:50:01 UTC
(In reply to comment #3)
> The problem is understood and fixed.  Fix has been tested and pushed upstream. 
> I will shortly be attaching the patch.
> 
> Subbu  

OK, great!

I didn't see anything on netdev (at least based on this subject), so I was just trying to figure out what needed to be done.

Thanks.

Comment 5 Subbu Seetharaman 2009-06-30 17:02:26 UTC
Created attachment 349974 [details]
patch to fix deadlock seen when rmmoding bonding driver

Current driver uses the MCC mailbox to post all f/w cmds. mbox posting is protected via a spin_lock(cmd_lock). This can result in a lockup for multicast_set and promiscous_config cmds that may be called in the BH context. spin_lock_bh() must not be used to prevent disabling of BHs while polling on the mbox. This patch modifies the driver to post these cmds on the MCC queue (rather than poll on the mbox) and the completions rcvd asynchronously. Async link status notifications are also rcvd as a part of MCC infrastructure.

These changes were submitted to netdev on 6/18 as a four patch series.

Subbu

Comment 6 Andrius Benokraitis 2009-07-01 19:51:37 UTC
Subbu - *please* make sure I'm included in the CC-list if you create any new bugzillas, thanks.

Comment 7 Subbu Seetharaman 2009-07-02 04:59:59 UTC
Sorry about that Andrius.  Will do that in future.

I have been using the the "depends on" field to indicate the patch order.  Is that the appropriate way to indicate the patch order.

Thanks.

Subbu

Comment 9 RHEL Program Management 2009-07-02 18:43:42 UTC
This request was evaluated by Red Hat Product Management for inclusion in a Red
Hat Enterprise Linux maintenance release.  Product Management has requested
further review of this request by Red Hat Engineering, for potential
inclusion in a Red Hat Enterprise Linux Update release for currently deployed
products.  This request is not yet committed for inclusion in an Update
release.

Comment 11 Don Zickus 2009-07-07 15:06:07 UTC
in kernel-2.6.18-157.el5
You can download this test kernel from http://people.redhat.com/dzickus/el5

Please do NOT transition this bugzilla state to VERIFIED until our QE team
has sent specific instructions indicating when to do so.  However feel free
to provide a comment indicating that this fix has been verified.

Comment 13 Subbu Seetharaman 2009-07-09 12:48:07 UTC
Verified on 2.6.18-157.

Subbu

Comment 15 Chris Ward 2009-08-03 15:47:30 UTC
~~ Attention Partners - RHEL 5.4 Snapshot 5 Released! ~~

RHEL 5.4 Snapshot 5 is the FINAL snapshot to be release before RC. It has been 
released on partners.redhat.com. If you have already reported your test results, 
you can safely ignore this request. Otherwise, please notice that there should be 
a fix available now that addresses this particular issue. Please test and report 
back your results here, at your earliest convenience.

If you encounter any issues while testing Beta, please describe the 
issues you have encountered and set the bug into NEED_INFO. If you 
encounter new issues, please clone this bug to open a new issue and 
request it be reviewed for inclusion in RHEL 5.4 or a later update, if it 
is not of urgent severity. If it is urgent, escalate the issue to your partner manager as soon as possible. There is /very/ little time left to get additional code into 5.4 before GA.

Partners, after you have verified, do not flip the bug status to VERIFIED. Instead, please set your Partner ID in the Verified field above if you have successfully verified the resolution of this issue. 

Further questions can be directed to your Red Hat Partner Manager or other 
appropriate customer representative.

Comment 17 errata-xmlrpc 2009-09-02 08:15:23 UTC
An advisory has been issued which should help the problem
described in this bug report. This report is therefore being
closed with a resolution of ERRATA. For more information
on therefore solution and/or where to find the updated files,
please follow the link below. You may reopen this bug report
if the solution does not work for you.

http://rhn.redhat.com/errata/RHSA-2009-1243.html


Note You need to log in before you can comment on or make changes to this bug.