RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 669739 - bump domain memory limits
Summary: bump domain memory limits
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Enterprise Linux 6
Classification: Red Hat
Component: kernel
Version: 6.0
Hardware: Unspecified
OS: Unspecified
urgent
medium
Target Milestone: rc
: ---
Assignee: Igor Mammedov
QA Contact: Virtualization Bugs
URL:
Whiteboard:
: 716274 (view as bug list)
Depends On:
Blocks: 653816 716498 716539
TreeView+ depends on / blocked
 
Reported: 2011-01-14 15:32 UTC by Andrew Jones
Modified: 2013-01-09 23:29 UTC (History)
16 users (show)

Fixed In Version: kernel-2.6.32-163.el6
Doc Type: Bug Fix
Doc Text:
Memory limit for x86_64 domU PV guests has been increased to 128 GB: CONFIG_XEN_MAX_DOMAIN_MEMORY=128.
Clone Of:
: 716498 (view as bug list)
Environment:
Last Closed: 2011-12-06 12:41:15 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)
[RHEL6.2 Xen PATCH V2] xen: bump memory limit for x86_64 domU PV guest to 128Gb (1.36 KB, patch)
2011-06-24 17:03 UTC, Igor Mammedov 		no flags Details | Diff
[RHEL6.2 Xen PATCH V3] xen: bump memory limit for x86_64 domU PV guest to 128Gb (1.21 KB, patch)
2011-06-24 17:50 UTC, Igor Mammedov 		no flags Details | Diff
Show Obsolete (1) View All


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHSA-2011:1530 0 normal SHIPPED_LIVE Moderate: Red Hat Enterprise Linux 6 kernel security, bug fix and enhancement update 2011-12-06 01:45:35 UTC

Description Andrew Jones 2011-01-14 15:32:08 UTC 
RHEL6 arch/x86/xen/Kconfig sets 32-bit guests to 8G and 64-bit guests to 32G for maximum memory. Upstream now has that at 128, which makes more sense considering the pseudo-physical memory map allows up to 168G.
Comment 2 Andrew Jones 2011-01-24 10:35:19 UTC 
Thinking about this more we should probably take all of

commit 58e05027b530ff081ecea68e38de8d59db8f87e0
Author: Jeremy Fitzhardinge <jeremy.fitzhardinge>
Date:   Fri Aug 27 13:28:48 2010 -0700

    xen: convert p2m to a 3 level tree

which is the upstream patch that bumps the memory limit. If we don't take this whole patch then we'll have a cost of one page per gig. Right now we have the small cost of 8 pages for 32-bit guests and 32 pages for 64-bit guests. We could maybe double those without being too wasteful, but going to 128 would certainly be overly expensive. The full upstream patch switches to using early_brk() when setting up the p2m map, and thus any unused pages that were reserved for early_brk are freed.

Since nobody seems to be hitting the current limits, then I'm inclined to move the consideration of the full backport to 6.2, and not even bother doing the Kconfig change to increase (double?) the current limits.
Comment 3 Paolo Bonzini 2011-04-20 13:02:09 UTC 
http://xen.1045712.n5.nabble.com/PATCH-xen-convert-p2m-to-a-3-level-tree-partial-revert-td3359827.html points out a possible regression from bumping the memory limits.  Upstream commits e5f15b45 and 14988a4d should fix this.
Comment 4 Igor Mammedov 2011-05-09 15:18:30 UTC 
upstream 8e1b4cf210 maybe useful here too.
Comment 5 Andrew Jones 2011-06-24 08:23:02 UTC 
*** Bug 716274 has been marked as a duplicate of this bug. ***
Comment 6 Andrew Jones 2011-06-24 08:28:41 UTC 
We need to bump up to at least 70G for x86_64 guests per the requirements of
one customer. At this time we have no request to change 32-bit guest limits,
but while we're in the business it might be good to try 16G.
Comment 7 RHEL Program Management 2011-06-24 08:39:51 UTC 
This request was evaluated by Red Hat Product Management for inclusion
in a Red Hat Enterprise Linux maintenance release. Product Management has 
requested further review of this request by Red Hat Engineering, for potential
inclusion in a Red Hat Enterprise Linux Update release for currently deployed 
products. This request is not yet committed for inclusion in an Update release.
Comment 8 Igor Mammedov 2011-06-24 12:44:53 UTC 
Backported 58e05027b530ff0 and patches it depends on.

Tested x32 PV guest with 10Gb RAM on my WS (boots/saves/resumes).

Waiting for a reservation of a beaker host with sufficient amount of memory to
test x64 PV guest.
Comment 20 Aristeu Rozanski 2011-06-27 19:18:42 UTC 
Patch(es) available on kernel-2.6.32-163.el6
Comment 23 Martin Prpič 2011-08-26 13:40:30 UTC 
    Technical note added. If any revisions are required, please edit the "Technical Notes" field
    accordingly. All revisions will be proofread by the Engineering Content Services team.
    
    New Contents:
Memory limit for x86_64 domU PV guests has been increased to 128 GB: CONFIG_XEN_MAX_DOMAIN_MEMORY=128.
Comment 24 Qin Guan 2011-10-31 04:41:00 UTC 
Verify this problem with kernel-2.6.32-202.el6 (128G memory guest excluded).

Host Version: 
2.6.18-286.el5xen, x86_64
xen-3.0.3-134.el5

Guest Version:
kernel-2.6.32-202.el6, pv

Test Matrix:

Host(x86_64): 
- AMD, Intel
Guest Arch i386:
- Memory Size: 512M, 4G, 8G
Guest Arch x86_64:
- Memory Size: 1G, 4G, 16G, 32G, 70G, 128G
Guest CPU: 
- UP, SMP

For guest with 128G memory, sanity test pass with kernel-2.6.32-211.el6. Please
refer to bug 743590 comment 8.
Comment 25 errata-xmlrpc 2011-12-06 12:41:15 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

http://rhn.redhat.com/errata/RHSA-2011-1530.html
Note You need to log in before you can comment on or make changes to this bug.