RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 1223376 - not enough MMIO resources for SR-IOV
Summary: not enough MMIO resources for SR-IOV
Keywords:
Status: CLOSED CANTFIX
Alias: None
Product: Red Hat Enterprise Linux 7
Classification: Red Hat
Component: kernel
Version: 7.1
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: rc
: ---
Assignee: Stefan Assmann
QA Contact: zenghui.shi
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2015-05-20 12:23 UTC by Alona Kaplan
Modified: 2021-01-29 04:07 UTC (History)
11 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2015-05-27 10:16:32 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)
lspci --vvv (output for enp2s0f0) (4.45 KB, text/plain)
2015-05-20 12:23 UTC, Alona Kaplan
no flags Details
lspci --vvv (output for enp2s0f1) (4.21 KB, text/plain)
2015-05-20 12:24 UTC, Alona Kaplan
no flags Details
modinfo igb (2.57 KB, text/plain)
2015-05-20 12:26 UTC, Alona Kaplan
no flags Details
dmesg (72.62 KB, text/plain)
2015-05-27 08:52 UTC, Alona Kaplan
no flags Details

Description Alona Kaplan 2015-05-20 12:23:25 UTC
Created attachment 1027699 [details]
lspci --vvv (output for enp2s0f0)

Description of problem:
The host has two SR-IOV nics- enp2s0f0 and enp2s0f1.
enp2s0f0 works fine.
However, when trying to configure VFs on enp2s0f1 the following error is thrown- kernel: igb 0000:02:00.1: not enough MMIO resources for SR-IOV.

Version-Release number of selected component (if applicable):


How reproducible:
100%

Steps to Reproduce:
1. ssh root.16.144
2. echo 1 > /sys/class/net/enp2s0f1/device/sriov_numvfs

Actual results:
-bash: echo: write error: Cannot allocate memory

journalctl output-
May 20 12:41:02 nari04.eng.lab.tlv.redhat.com kernel: igb 0000:02:00.1: not enough MMIO resources for SR-IOV



Expected results:
Succeed creating VFs on enp2s0f1.

Additional info:
The host's ip- nari04.eng.lab.tlv.redhat.com (10.35.16.144).
Kernel version- 3.10.0-229.4.2.el7.x86_64
sriov driver- igb (version- 5.2.13-k)
Ethernet controller- Intel Corporation 82576 Gigabit Network Connection (rev 01)

Comment 1 Alona Kaplan 2015-05-20 12:24:19 UTC
Created attachment 1027700 [details]
lspci --vvv (output for enp2s0f1)

Comment 2 Alona Kaplan 2015-05-20 12:26:45 UTC
Created attachment 1027703 [details]
modinfo igb

Comment 4 Alon Bar-Lev 2015-05-20 12:51:35 UTC
The non operational (second) card has:
---
        Capabilities: [160 v1] Single Root I/O Virtualization (SR-IOV)
                IOVCap: Migration-, Interrupt Message Number: 000
                IOVCtl: Enable- Migration- Interrupt- MSE- ARIHierarchy-
                IOVSta: Migration-
                Initial VFs: 8, Total VFs: 8, Number of VFs: 0, Function Dependency Link: 01
                VF offset: 128, stride: 2, Device ID: 10ca
                Supported Page Size: 00000553, System Page Size: 00000001
                Region 0: Memory at 0000000000000000 (64-bit, non-prefetchable)
                Region 3: Memory at 0000000000000000 (64-bit, non-prefetchable)
                VF Migration: offset: 00000000, BIR: 0
---

Notice the 0 at regions.
This happens at two different machines, it is not specific to a single configuration.
Kernel command-line includes intel_iommu=on.

Comment 5 Alona Kaplan 2015-05-20 12:56:18 UTC
Alon tried to reproduce the issue using vanilla kernel (3.18.12). It seems to be even worse, it was impossible to create VFs on both of the nics (both of them had 0 at regions).

Comment 6 Stefan Assmann 2015-05-27 07:30:45 UTC
A full dmesg output would be helpful. Meanwhile try the following kernel cmdline options one after another.
pci=assign-busses
pci=realloc

Comment 7 Alona Kaplan 2015-05-27 08:52:17 UTC
Created attachment 1030426 [details]
dmesg

Comment 8 Stefan Assmann 2015-05-27 09:03:10 UTC
pci=nocrs would be another kernel cmdline option to try.

Comment 9 Stefan Assmann 2015-05-27 10:16:32 UTC
Not enough MMIO resources is a BIOS issue, so you might check if there's a newer BIOS available. If none of the suggested workarounds help you're pretty much out of luck.
There's been a similar case, discussed in bug #723583.

Going to close this as CANTFIX, as it is a BIOS issue and possible workarounds have been listed.

Comment 10 Alona Kaplan 2015-05-28 05:47:28 UTC
pci=realloc solved the issue. Thanks.


Note You need to log in before you can comment on or make changes to this bug.