| Summary: | ib_srp scan/rescan keep adding new scsi devices | ||
|---|---|---|---|
| Product: | Red Hat Enterprise Linux 6 | Reporter: | George Beshers <gbeshers> |
| Component: | kernel | Assignee: | Doug Ledford <dledford> |
| Status: | CLOSED ERRATA | QA Contact: | Infiniband QE <infiniband-qe> |
| Severity: | medium | Docs Contact: | |
| Priority: | unspecified | ||
| Version: | 6.2 | CC: | gbeshers, honli, ltroan, randerso, tziporet, vlad, yevgenyp |
| Target Milestone: | beta | Keywords: | OtherQA |
| Target Release: | 6.2 | ||
| Hardware: | x86_64 | ||
| OS: | Linux | ||
| Whiteboard: | |||
| Fixed In Version: | kernel-2.6.32-193.el6 | Doc Type: | Bug Fix |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2011-12-06 13:08:55 UTC | Type: | --- |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Bug Depends On: | |||
| Bug Blocks: | 643467, 659725, 688933, 735499 | ||
Re-tested using Red Hat Enterprise Linux Server release 6.1 ga. The problem still exists. # uname -a Linux pef3159.engr.sgi.com 2.6.32-131.0.15.el6.x86_64 #1 SMP Tue May 10 15:42:40 EDT 2011 x86_64 x86_64 x86_64 GNU/Linux --Sammy Patch(es) available on kernel-2.6.32-193.el6 Adding Mellanox to the cc list of this public bug. Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. http://rhn.redhat.com/errata/RHSA-2011-1530.html |
Description of problem: On a system w/RHEL 6 GA and accessing native IB storage arrays. A scan/rescan keep adding new scsi devices after executing the following command line # echo "- - -" > /sys/class/scsi_host/hostXX/scan #uname -r 2.6.32-71.el6.x86_64 # modinfo ib_srp filename: /lib/modules/2.6.32-71.el6.x86_64/kernel/drivers/infiniband/ulp/srp/ib_srp.ko license: Dual BSD/GPL description: InfiniBand SCSI RDMA Protocol initiator v0.2 (November 1, 2005) author: Roland Dreier srcversion: 9963F1B0823FC5B60CBF71C depends: ib_core,ib_cm,ib_sa,scsi_transport_srp vermagic: 2.6.32-71.el6.x86_64 SMP mod_unload modversions parm: srp_sg_tablesize:Max number of gather/scatter entries per I/O (default is 12, max 255) (int) parm: topspin_workarounds:Enable workarounds for Topspin/Cisco SRP target bugs if != 0 (int) parm: mellanox_workarounds:Enable workarounds for Mellanox SRP target bugs if != 0 (int) Version-Release number of selected component (if applicable): Unknown. How reproducible: Always. Steps to Reproduce: 1. Login in to a system with connections to native IB storage array with four or more LUNs. 2. Load ib_srp kernel module 3. Start rdma service 4. For each HCA connection to the storage array execute the following command # opensm -g <hca_guid_hexValue> & For example, # opensm -g 0x0002c903000711c9 & # opensm -g 0x0002c903000711d5 & 5. For each /dev/infinband/umad<#> that's associated with a storage array connection, execute the following command # srp_daemon -c -a -o -e -d /dev/infiniband/umad<#> & For example, # srp_daemon -c -a -o -e -d /dev/infiniband/umad0 & # srp_daemon -c -a -o -e -d /dev/infiniband/umad1 & 6. Execute lsscsi. 7. Execute echo "- - -" > /sys/class/scsi_host/hostXX/scan, where XX is the host associated with native IB storage array devices. For example, # echo "- - -" > /sys/class/scsi_host/host17/scan Actual results: Caused additional SCSI targets to be created per SCSI host (see example output below). [17:0:0:0] disk LSI INF-01-00 8780 /dev/sdad [17:0:0:1] disk LSI INF-01-00 8780 /dev/sdag [17:0:0:2] disk LSI INF-01-00 8780 /dev/sdaj [17:0:0:3] disk LSI INF-01-00 8780 /dev/sdak [17:0:0:31] disk LSI Universal Xport 8780 /dev/sdal [17:0:1:0] disk LSI INF-01-00 8780 /dev/sdam [17:0:1:1] disk LSI INF-01-00 8780 /dev/sdan [17:0:1:2] disk LSI INF-01-00 8780 /dev/sdao [17:0:1:3] disk LSI INF-01-00 8780 /dev/sdap [17:0:1:31] disk LSI Universal Xport 8780 /dev/sdaq [17:0:2:0] disk LSI INF-01-00 8780 /dev/sdar [17:0:2:1] disk LSI INF-01-00 8780 /dev/sdas [17:0:2:2] disk LSI INF-01-00 8780 /dev/sdat [17:0:2:3] disk LSI INF-01-00 8780 /dev/sdau [17:0:2:31] disk LSI Universal Xport 8780 /dev/sdav [17:0:3:0] disk LSI INF-01-00 8780 /dev/sdaw [17:0:3:1] disk LSI INF-01-00 8780 /dev/sdax [17:0:3:2] disk LSI INF-01-00 8780 /dev/sday [17:0:3:3] disk LSI INF-01-00 8780 /dev/sdaz [17:0:3:31] disk LSI Universal Xport 8780 /dev/sdba [17:0:4:0] disk LSI INF-01-00 8780 /dev/sdbb [17:0:4:1] disk LSI INF-01-00 8780 /dev/sdbc [17:0:4:2] disk LSI INF-01-00 8780 /dev/sdbd [17:0:4:3] disk LSI INF-01-00 8780 /dev/sdbe [17:0:4:31] disk LSI Universal Xport 8780 /dev/sdbf [17:0:5:0] disk LSI INF-01-00 8780 /dev/sdbg [17:0:5:1] disk LSI INF-01-00 8780 /dev/sdbh [17:0:5:2] disk LSI INF-01-00 8780 /dev/sdbi [17:0:5:3] disk LSI INF-01-00 8780 /dev/sdbj [17:0:5:31] disk LSI Universal Xport 8780 /dev/sdbk [17:0:6:0] disk LSI INF-01-00 8780 /dev/sdbl [17:0:6:1] disk LSI INF-01-00 8780 /dev/sdbm [17:0:6:2] disk LSI INF-01-00 8780 /dev/sdbn [17:0:6:3] disk LSI INF-01-00 8780 /dev/sdbo [17:0:6:31] disk LSI Universal Xport 8780 /dev/sdbp [17:0:7:0] disk LSI INF-01-00 8780 /dev/sdbq [17:0:7:1] disk LSI INF-01-00 8780 /dev/sdbr [17:0:7:2] disk LSI INF-01-00 8780 /dev/sdbs [17:0:7:3] disk LSI INF-01-00 8780 /dev/sdbt [17:0:7:31] disk LSI Universal Xport 8780 /dev/sdbu Expected results: There shouldn't be additional SCSI targets created per SCSI Host (see example output below). [17:0:0:0] disk LSI INF-01-00 8780 /dev/sdad [17:0:0:1] disk LSI INF-01-00 8780 /dev/sdag [17:0:0:2] disk LSI INF-01-00 8780 /dev/sdaj [17:0:0:3] disk LSI INF-01-00 8780 /dev/sdak [17:0:0:31] disk LSI Universal Xport 8780 /dev/sdal Additional info: This issue has been addressed in ofed 1.4.1. The following is an excerpt from ofed srp relnotes. ==================================================================== 2. Changes and Bug Fixes since OFED 1.3.1 ==================================================================== * Check for scsi_id in scmnd to prevent scan/rescan keep adding new scsi devices Workaround: Use the following command line. # echo "0 0 -" > /sys/class/scsi_host/hostXX/scan