Bug 514926

Summary: [Broadcom 5.5 bug] iSCSI does not reconnect after ifdown and ifup
Product: Red Hat Enterprise Linux 5 Reporter: Michael Chan <mchan>
Component: iscsi-initiator-utilsAssignee: Mike Christie <mchristi>
Status: CLOSED ERRATA QA Contact: Red Hat Kernel QE team <kernel-qe>
Severity: urgent Docs Contact:
Priority: urgent    
Version: 5.4CC: andriusb, bdonahue, benli, benl, benlu, bzeranski, coughlan, cward, eddie.wai, edwardn, ejratl, emcnabb, emoryb, enarvaez, epollard, jjarvis, martin.wilck, mcarlson, mchan, mchristi, mnovacek, nandkumar.mane, niran, plyons, rlerch, sghosh, syeghiay, xdl-redhat-bugzilla
Target Milestone: rcKeywords: OtherQA, ZStream
Target Release: 5.5   
Hardware: All   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Removing the <filename>bnx2</filename> modules or running ifdown on the network interface being used by <filename>bnx2i</filename> driver will result in the iSCSI sessions being disconnected. Reloading the module or running ifup, will not reconnect the SCSI sessions. To work around this issue, the iscsi service must be stopped and then restarted.
Story Points: ---
Clone Of: 513726 Environment:
Last Closed: 2010-03-30 08:57:07 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 441979, 513726    
Bug Blocks: 513501, 533941, 549629    

Description Michael Chan 2009-07-31 14:44:10 UTC
+++ This bug was initially created as a clone of Bug #513726 +++

Using bnx2i Broadcom iSCSI, when the network interface is brought down with active iSCSI sessions, these sessions do not get reconnected after the interface is brought up again.  It looks like the uIP daemon is unaware of the reconnections and is not opening uio to handle the neighbor requests.

Comment 1 Tom Coughlan 2009-07-31 15:52:40 UTC
If this problem is specific to the bnx2i, then this is probably something we should release note in 5.4, and plan to fix in 5.5, considering the RHEL 5.4 schedule.

Comment 4 Mike Christie 2009-07-31 17:11:05 UTC
Here is a proposed release note:

Removing the bnx2 modules or running ifdown on the network interface being used by bnx2i, will result in the iSCSI sessions being disconnected. Reloading the module or running ifup, will not result in the SCSI sessions being reconnected. You must also stop the iscsi service, and then relogin by restarting the iscsi service.

Comment 5 Andrius Benokraitis 2009-08-03 15:26:55 UTC
Release note added. If any revisions are required, please set the 
"requires_release_notes" flag to "?" and edit the "Release Notes" field accordingly.
All revisions will be proofread by the Engineering Content Services team.

New Contents:
Removing the bnx2 modules or running ifdown on the network interface being used by bnx2i, will result in the iSCSI sessions being disconnected. Reloading the module or running ifup, will not result in the SCSI sessions being reconnected. You must also stop the iscsi service, and then relogin by restarting the iscsi service.

Comment 8 Ryan Lerch 2009-08-19 01:11:23 UTC
Release note updated. If any revisions are required, please set the 
"requires_release_notes"  flag to "?" and edit the "Release Notes" field accordingly.
All revisions will be proofread by the Engineering Content Services team.

Diffed Contents:
@@ -1 +1 @@
-Removing the bnx2 modules or running ifdown on the network interface being used by bnx2i, will result in the iSCSI sessions being disconnected. Reloading the module or running ifup, will not result in the SCSI sessions being reconnected. You must also stop the iscsi service, and then relogin by restarting the iscsi service.+Removing the <filename>bnx2</filename> modules or running ifdown on the network interface being used by <filename>bnx2i</filename> driver will result in the iSCSI sessions being disconnected. Reloading the module or running ifup, will not reconnect the SCSI sessions. To work around this issue, the iscsi service must be stopped and then restarted.

Comment 12 Chris Ward 2009-10-13 15:15:34 UTC
@Broadcom,

We need to confirm that there is commitment to test 
for the resolution of this request during the RHEL 5.5 test
phase, if it is accepted into the release. 

Please post a confirmation before Oct 16th, 2009, 
including the contact information for testing engineers.

Comment 13 Michael Chan 2009-10-13 16:35:38 UTC
Yes, adding QA managers Nasser and Eddie to assign test engineers.

Comment 14 Ed Narvaez 2009-10-30 16:41:13 UTC
Yes, bnx2i test engineer contact info is:

Emory Bestenlehner, emoryb, 949-926-6731

We will be posting test results when available periodically.

If there are any questions/problems, please contact me.

Ed Narvaez, enarvaez, 949-926-6456

Comment 16 Emory Bestenlehner 2009-12-08 02:56:57 UTC
You can also reach me via cell 714 366 1986, or my lab phone 949 926 8482. The above # is my office phone. Use these two numbers primarily, I'm rarely in my office.

Thanks

Comment 17 edwardn 2009-12-11 02:28:55 UTC
Quick update from Broadcom:
I was told that iscsi-initiator-utils-6.2.0.871-0.11.el5.x86_64.rpm along with kernel-2.6.18-178.el5.x86_64.rpm might fix this problem.  I tried the following combination and the iSCSI session still does not recover after an ifconfig down/up.

Comment 18 Mike Christie 2009-12-14 18:56:48 UTC
Ben,

Could Edward be hitting the same thing I was? Does the update here
http://people.redhat.com/mchristi/iscsi/rhel5.5/iscsi-initiator-utils/
work for you?

Comment 19 Benjamin Li 2009-12-14 19:42:14 UTC
Hi Mike,

I tried the iscsi-utils located at the URL you posted, iscsi-initiator-utils-6.2.0.871-0.11.el5, and I think it might be a different problem.  I will work with Ed and Anil to see if we can narrow this down.

Thanks again.

Comment 20 Andrius Benokraitis 2009-12-17 18:51:39 UTC
OK, looks like this is waiting on Broadcom for more investigation. Correct me if I'm wrong here. Please keep us posted.

Comment 21 Michael Chan 2009-12-17 19:58:18 UTC
Yes, Broadcom engineering is debugging this.

Comment 23 Mike Christie 2009-12-21 02:55:05 UTC
Hey Ben,

I update the iscsi-initiator-utils rpm with your uip reopen con patch here
http://people.redhat.com/mchristi/iscsi/rhel5.4.z/iscsi-initiator-utils/

Comment 24 Mike Christie 2009-12-22 06:50:12 UTC
Hey, the rpm in comment #23 is for 5.4.z.

The rpm for 5.5 is here
http://people.redhat.com/mchristi/iscsi/rhel5.5/iscsi-initiator-utils/
It has your fixes plus bnx2x support and some other fixes.

Comment 27 edwardn 2009-12-22 08:29:46 UTC
Tried the initiator in comment #23 (iscsi-initiator-utils-6.2.0.871-0.12.el5) with the 5.4.z kernel and the issue appears to be resolved.

Comment 29 errata-xmlrpc 2010-03-30 08:57:07 UTC
An advisory has been issued which should help the problem
described in this bug report. This report is therefore being
closed with a resolution of ERRATA. For more information
on therefore solution and/or where to find the updated files,
please follow the link below. You may reopen this bug report
if the solution does not work for you.

http://rhn.redhat.com/errata/RHBA-2010-0293.html