Bug 499611 - Hotplugging vcpus to an F-11 64-bit Xen domU doesn't work
Hotplugging vcpus to an F-11 64-bit Xen domU doesn't work
Product: Fedora
Classification: Fedora
Component: udev (Show other bugs)
All Linux
low Severity medium
: ---
: ---
Assigned To: Harald Hoyer
Fedora Extras Quality Assurance
Depends On:
Blocks: F11VirtTarget 523127 630947
  Show dependency treegraph
Reported: 2009-05-07 08:42 EDT by Chris Lalancette
Modified: 2010-09-07 09:08 EDT (History)
13 users (show)

See Also:
Fixed In Version: udev-145-13.fc12
Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of:
: 523127 (view as bug list)
Last Closed: 2010-06-28 08:24:46 EDT
Type: ---
Regression: ---
Mount Type: ---
Documentation: ---
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---

Attachments (Terms of Use)
CPU online patch (484 bytes, patch)
2009-05-20 12:28 EDT, Justin M. Forbes
no flags Details | Diff

  None (edit)
Description Chris Lalancette 2009-05-07 08:42:04 EDT
Description of problem:
Following the test case here:


I'm trying to plug and unplug virtual CPUs from an F-11 x86_64 Xen guest.  I boot up the guest with 8 vcpus, and all 8 are shown in /proc/cpuinfo.  Then, on the dom0, I issue:

# xm vcpu-set f11 2

Which unplugs 6 of the vcpus.  Now only 2 cpus are shown in the guest.  However, if I now do:

# xm vcpu-set f11 8

Nothing happens.  What should happen is that we should hotplug 6 more vcpus into the guest, and now the guest should have the original 8 vcpus.
Comment 1 Chris Lalancette 2009-05-08 11:21:53 EDT
     Another fairly important thing to get working in upstream and Fedora.

Chris Lalancette
Comment 2 Jeremy Fitzhardinge 2009-05-11 13:36:24 EDT
It needs some usermode support to work.  It will generate uevents, and a script is needed to do the actual onlining.  You can see that the cpus will appear and disappear in /sys/devices/system/cpu/present.

This is a behaviour change from older Xen kernels which did this internally, but seemed like the better approach.
Comment 3 Justin M. Forbes 2009-05-11 13:49:01 EDT
So I suppose the question here would be where should such a script live? With the pv_ops domU kernel, there is no difference in a PV domU install and a bare metal.
Comment 4 Jeremy Fitzhardinge 2009-05-11 13:57:48 EDT
Do you mean "which package" or "which filesystem"?

The idea is that this should be the same as a native system with hotplug physical cpus; you insert the CPU module, then a hotplug script actually onlines them.  There's nothing Xen-specific about the script or what it does.

(Though I'm not certain that real cpu hotplug works like this.)
Comment 5 Justin M. Forbes 2009-05-15 12:19:47 EDT
Right, so it appears that real hotplug can work like this just fine as well.  The real question: is there any reason we should not make udev online cpus on an add?  The arguments I have seen against this are power consumption related.  Udev certainly gets events on the CPU add or removal, and making it online a CPU on add would be trivial.  It has certainly changed from a mechanism question to a policy question.
Comment 6 Daniel Berrange 2009-05-15 12:31:06 EDT
The uevents / sysfs  notication/online Jeremy mentions in comment #2, sounds like exactly the same thing Glauba came up against when trying todo KVM CPU hotplug. I can't remember whether he ended up using this or not, but it would make sense for us to have same CPU onlining process for KVM and Xen guests if practical.
Comment 7 Justin M. Forbes 2009-05-15 12:43:42 EDT
kvm would work the same way.  Essentially it is a udev rule.  After thinking on it a bit, I believe the rule is necessary.  I find it hard to believe that people who really care about power management would add a CPU to a running system without a desire to online that CPU.  Most power management would be achieved by taking existing CPUs online or offline without attaching or removing them.  The udev rule would only online a CPU when it is attached, meaning CPUs that you specifically offline but leave present would not change state.
Comment 8 Justin M. Forbes 2009-05-20 12:28:44 EDT
Created attachment 344840 [details]
CPU online patch

Attached a patch which automatically onlines CPUs as they are added.  Tested with several add and removes on F-11.
Comment 9 Bug Zapper 2009-06-09 11:19:08 EDT
This bug appears to have been reported against 'rawhide' during the Fedora 11 development cycle.
Changing version to '11'.

More information and reason for this action is here:
Comment 10 Harald Hoyer 2009-06-30 07:12:08 EDT
Why does the kernel not bring the CPUs online? Aren't real CPUs brought online immediately?
Comment 11 Justin M. Forbes 2009-09-25 11:20:10 EDT
Not sure to be honest, but there is no harm in onlining an already online cpu.  And I suspect that virt users are far more likely to hotplug CPUs than bare metal.
Comment 12 Bug Zapper 2010-04-27 10:10:52 EDT
This message is a reminder that Fedora 11 is nearing its end of life.
Approximately 30 (thirty) days from now Fedora will stop maintaining
and issuing updates for Fedora 11.  It is Fedora's policy to close all
bug reports from releases that are no longer maintained.  At that time
this bug will be closed as WONTFIX if it remains open with a Fedora 
'version' of '11'.

Package Maintainer: If you wish for this bug to remain open because you
plan to fix it in a currently maintained version, simply change the 'version' 
to a later Fedora version prior to Fedora 11's end of life.

Bug Reporter: Thank you for reporting this issue and we are sorry that 
we may not be able to fix it before Fedora 11 is end of life.  If you 
would still like to see this bug fixed and are able to reproduce it 
against a later version of Fedora please change the 'version' of this 
bug to the applicable version.  If you are unable to change the version, 
please add a comment here and someone will do it for you.

Although we aim to fix as many bugs as possible during every release's 
lifetime, sometimes those efforts are overtaken by events.  Often a 
more recent Fedora release includes newer upstream software that fixes 
bugs or makes them obsolete.

The process we are following is described here: 
Comment 13 Harald Hoyer 2010-04-28 02:43:32 EDT
should be fixed.. bug is in "MODIFIED"
Comment 14 Andrew Jones 2010-04-28 03:37:25 EDT
Oops, sorry, I shot from the hip here when I bumped this up to f13. I forgot this bug was for host physical cpu hotplug, not guest vcpu hotplug. Resetting this to 11 to allow it to be CLOSED.
Comment 15 Bug Zapper 2010-06-28 08:24:46 EDT
Fedora 11 changed to end-of-life (EOL) status on 2010-06-25. Fedora 11 is 
no longer maintained, which means that it will not receive any further 
security or bug fix updates. As a result we are closing this bug.

If you can reproduce this bug against a currently maintained version of 
Fedora please feel free to reopen this bug against that version.

Thank you for reporting this bug and we are sorry it could not be fixed.

Note You need to log in before you can comment on or make changes to this bug.