Bug 749816 - libibverbs can't find running IB devices
Summary: libibverbs can't find running IB devices
Keywords:
Status: CLOSED NOTABUG
Alias: None
Product: Red Hat Enterprise Linux 6
Classification: Red Hat
Component: libibverbs
Version: 6.2
Hardware: x86_64
OS: Linux
unspecified
high
Target Milestone: rc
: ---
Assignee: Doug Ledford
QA Contact: Red Hat Kernel QE team
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2011-10-28 14:45 UTC by Ben England
Modified: 2011-10-28 15:01 UTC (History)
0 users

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2011-10-28 15:01:36 UTC
Target Upstream Version:


Attachments (Terms of Use)

Description Ben England 2011-10-28 14:45:04 UTC
Description of problem:

The attached program cannot find any running IB devices, even though devices are running on the system.  I think I loaded the relevant drivers (why don't they automatically load?).

Version-Release number of selected component (if applicable):

list of installed RPMs is in attachment.

How reproducible:

Very

Steps to Reproduce:
1. Bring up Infiniband interfaces, including subnet manager and IP interface, verify that these work as expected
2. try running the simple program in attachment that searches for IB devices
  
Actual results:

It finds no devices, program is attached:

[root@perf56 ~]# ./ibvls 
libibverbs: Warning: no userspace device-specific driver found for /sys/class/infiniband_verbs/uverbs1
libibverbs: Warning: no userspace device-specific driver found for /sys/class/infiniband_verbs/uverbs0
ibv_get_device_list: list=0x1f08040 num_hcas=0
[

Expected results:

It should find every active IB interface.

Additional info:

I found this while trying to configure Gluster to use RDMA over this release, I'll fall back to 6.1 and see if it happens there.  The attachment contains these files:

sys-class-infiniband-verbs.log -- output of ls -l on /sys/class/infiniband_verbs/*
rpms.log -- rpm -qa output
ibvls.c -- program to scan list of Infiniband devices usinb libibverbs
ib0.log -- interface was up and running
lsmod.log -- what drivers were loaded when test was run

Comment 2 Doug Ledford 2011-10-28 15:01:36 UTC
This is not a bug.  The error you are getting is because you haven't installed the user space hardware drivers to go along with the libibverbs package.

The RDMA stack is complex and requires quite a lot of packages to get up and running.  There is rather good documentation on going from a bare machine to an up and running RDMA system in the knowledge base.


Note You need to log in before you can comment on or make changes to this bug.