Bug 725492

Summary: VM gets paused after several migrations.
Product: Red Hat Enterprise Linux 6 Reporter: Jaroslav Henner <jhenner>
Component: qemu-kvmAssignee: Orit Wasserman <owasserm>
Status: CLOSED DUPLICATE QA Contact: Virtualization Bugs <virt-bugs>
Severity: high Docs Contact:
Priority: medium    
Version: 6.1CC: acathrow, bugzilla-qe-tlv, dallan, dyuan, eblake, hhuang, iheim, juzhang, michen, mkenneth, mzhan, qzhang, rwu, shu, syeghiay, tburke, virt-maint, weizhan, whuang, xhu
Target Milestone: rcKeywords: Reopened
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2012-08-08 13:38:06 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Attachments:
Description Flags
logs
none
logs
none
qemu logs
none
qemu+messages logs
none
Required logs none

Description Jaroslav Henner 2011-07-25 16:09:27 UTC 
Description of problem:
Migrating diskless VM without any OS causes the VM to get paused after several migrations. After that, even migrating diskfull machines causes them to get stopped. When trying to resume it, rhevm says it is running already. Stopping it works.

Version-Release number of selected component (if applicable):
libvirt-0.9.3-7.el6.x86_64
vdsm-4.9-84.el6.x86_64

How reproducible:
50%


Steps to Reproduce:
1. Have a VM (diskless) on iSCSI
2. Migrate until it gets paused
3.
  
Actual results:
Paused VM.


Expected results:
VM migrated.

Additional info:
Comment 2 Jaroslav Henner 2011-07-25 16:36:25 UTC 
Created attachment 515109 [details]
logs

All hosts should have been synchronized by ntpd when bug appeared.

There are at least these interesting messages in the logs:



16:44:01 - The involved VM was created (there was only one in that time)
There were like 3 sucessfull migrations between the hosts.

16:45:17.197: 1927: error : qemuGetSchedulerType:5077 : Requested operation is not valid: cgroup CPU controller is not mounted

Thread-135::ERROR::2011-07-25 16:45:27,387::guestIF::300::vm.Vm::(run) vmId=`0795e848-e841-47c0-934f-b0f643e3e376`::Unexpected exception: Traceback (most recent call last):
  File "/usr/share/vdsm/guestIF.py", line 292, in run
    s, leftover = self._readMessage(leftover)
  File "/usr/share/vdsm/guestIF.py", line 263, in _readMessage
    s = self._sock.recv(self.READSIZE)
error: [Errno 104] Connection reset by peer


Thread-134::ERROR::2011-07-25 16:45:27,805::utils::371::vm.Vm::(collect) vmId=`0795e848-e841-47c0-934f-b0f643e3e376`::Stats function failed: <AdvancedStatsFunction _sampleNet at 0x2a5e688>
Traceback (most recent call last):
  File "/usr/share/vdsm/utils.py", line 368, in collect
    statsFunction()
  File "/usr/share/vdsm/utils.py", line 252, in __call__
    retValue = self._function(*args, **kwargs)
  File "/usr/share/vdsm/libvirtvm.py", line 101, in _sampleNet
    netSamples[vmIface] = self._vm._dom.interfaceStats(vmIface)
  File "/usr/share/vdsm/libvirtvm.py", line 311, in f
    ret = attr(*args, **kwargs)
  File "/usr/share/vdsm/libvirtconnection.py", line 63, in wrapper
    ret = f(*args, **kwargs)
  File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1207, in interfaceStats
    if ret is None: raise libvirtError ('virDomainInterfaceStats() failed', dom=self)
libvirtError: Domain not found: no domain with matching uuid '0795e848-e841-47c0-934f-b0f643e3e376'


16:45:33.485: 1925: error : qemuGetSchedulerType:5077 : Requested operation is not valid: cgroup CPU controller is not mounted

16:45:40 - It was migrating from 213 to 206 and got paused.

16:45:41.348: 1923: debug : qemuProcessHandleStop:471 : Transitioned guest gdfs to paused state due to unknown event



I'm not sure whether this is related, but there was:
17:02:58.544: 2392: error : virNetSocketReadWire:886 : End of file while reading data: Input/output error
Maybe someone was restarting something on my setup.
Comment 3 Dave Allan 2011-07-25 18:51:11 UTC 
Please provide the domain xml for the VM.
Comment 4 Jaroslav Henner 2011-07-26 07:08:22 UTC 
(In reply to comment #3)
> Please provide the domain xml for the VM.

Where should I get it?
Comment 5 Eric Blake 2011-07-26 13:22:05 UTC 
(In reply to comment #4)
> (In reply to comment #3)
> > Please provide the domain xml for the VM.
> 
> Where should I get it?

virsh dumpxml domain_name > domain.xml
Comment 6 Jaroslav Henner 2011-07-26 15:31:05 UTC 
I have already changed my setup. So I reproduced and this is the domain xml.

<domain type='kvm' id='2'>
  <name>fgdsdfas</name>
  <uuid>5ac365c2-a5b2-4150-a95d-be92ca0e7412</uuid>
  <memory>524288</memory>
  <currentMemory>524288</currentMemory>
  <vcpu>1</vcpu>
  <sysinfo type='smbios'>
    <system>
      <entry name='manufacturer'>Red Hat</entry>
      <entry name='product'>RHEL</entry>
      <entry name='version'>6Server-6.1.0.2.el6_1</entry>
      <entry name='serial'>44454C4C-5800-1058-8059-C8C04F5A344A_84:2B:2B:BC:A5:D2</entry>
      <entry name='uuid'>5ac365c2-a5b2-4150-a95d-be92ca0e7412</entry>
    </system>
  </sysinfo>
  <os>
    <type arch='x86_64' machine='rhel6.0.0'>hvm</type>
    <boot dev='network'/>
    <boot dev='hd'/>
    <smbios mode='sysinfo'/>
  </os>
  <features>
    <acpi/>
  </features>
  <cpu match='exact'>
    <model>Conroe</model>
    <topology sockets='1' cores='1' threads='1'/>
  </cpu>
  <clock offset='variable' adjustment='0'/>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>destroy</on_crash>
  <devices>
    <emulator>/usr/libexec/qemu-kvm</emulator>
    <disk type='file' device='cdrom'>
      <driver name='qemu' type='raw'/>
      <target dev='hdc' bus='ide'/>
      <readonly/>
      <alias name='ide0-1-0'/>
      <address type='drive' controller='0' bus='1' unit='0'/>
    </disk>
    <controller type='virtio-serial' index='0' ports='16'>
      <alias name='virtio-serial0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
    </controller>
    <controller type='ide' index='0'>
      <alias name='ide0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
    </controller>
    <interface type='bridge'>
      <mac address='00:1a:4a:10:39:00'/>
      <source bridge='rhevm'/>
      <target dev='vnet0'/>
      <model type='virtio'/>
      <alias name='net0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
    </interface>
    <channel type='unix'>
      <source mode='bind' path='/var/lib/libvirt/qemu/channels/fgdsdfas.com.redhat.rhevm.vdsm'/>
      <target type='virtio' name='com.redhat.rhevm.vdsm'/>
      <alias name='channel0'/>
      <address type='virtio-serial' controller='0' bus='0' port='1'/>
    </channel>
    <input type='tablet' bus='usb'>
      <alias name='input0'/>
    </input>
    <input type='mouse' bus='ps2'/>
    <graphics type='vnc' port='5900' autoport='yes' listen='0' keymap='en-us' passwdValidTo='1970-01-01T00:00:01'/>
    <sound model='ich6'>
      <alias name='sound0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
    </sound>
    <video>
      <model type='cirrus' vram='9216' heads='1'/>
      <alias name='video0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
    </video>
    <memballoon model='none'>
      <alias name='balloon0'/>
    </memballoon>
  </devices>
  <seclabel type='dynamic' model='selinux'>
    <label>system_u:system_r:svirt_t:s0:c305,c397</label>
    <imagelabel>system_u:object_r:svirt_image_t:s0:c305,c397</imagelabel>
  </seclabel>
</domain>
Comment 7 Dave Allan 2011-07-26 16:48:28 UTC 
(In reply to comment #0)
> Migrating diskless VM without any OS causes the VM to get paused after several
> migrations. After that, even migrating diskfull machines causes them to get
> stopped. When trying to resume it, rhevm says it is running already. Stopping
> it works.

What does virsh report as the state of the VMs?
Comment 8 Jaroslav Henner 2011-07-27 14:06:57 UTC 
[root@srh-08 ~]# virsh list
Please enter your authentication name: vdsm@rhevh
Please enter your password: 
 Id Name                 State
----------------------------------
 10 h1                   paused
Comment 9 Jaroslav Henner 2011-08-02 09:28:32 UTC 
Created attachment 516286 [details]
logs
Comment 10 Michal Privoznik 2011-08-18 16:09:53 UTC 
From your logs:

11:11:14.229: 2791: debug : qemuMonitorEmitStop:896 : mon=0x7fbab40106d0
11:11:14.229: 2791: debug : qemuProcessHandleStop:374 : Transitioned guest masinka to paused state due to unknown event


This means, qemu send us STOP event. Unfortunately, you didn't provide qemu logs which could have been a little more helpful here.

However, if qemu stops a domain, there is not much libvirt can do.
Comment 11 Jaroslav Henner 2011-09-16 10:30:18 UTC 
Created attachment 523536 [details]
qemu logs
Comment 12 Michal Privoznik 2011-09-16 11:30:18 UTC 
From your recent attachment (nomadic_vm.log.dest):

kvm: unhandled exit 80000021
kvm_run returned -22

I guess that's why qemu sent the STOP event. Anyway, if qemu decide to pause itself, i don't libvirt should resume it. Maybe this is not libvirt but qemu bug.
Comment 13 Michal Privoznik 2011-09-16 15:48:28 UTC 
According to domain logs I believe this is a qemu issue. Therefore reassigning to qemu component.
Comment 14 Dor Laor 2011-09-19 12:14:05 UTC 
(In reply to comment #12)
> From your recent attachment (nomadic_vm.log.dest):
> 
> kvm: unhandled exit 80000021
> kvm_run returned -22
> 
> I guess that's why qemu sent the STOP event. Anyway, if qemu decide to pause
> itself, i don't libvirt should resume it. Maybe this is not libvirt but qemu
> bug.

The above is a crash and not stop event. We need to have the host kernel logs too. It's unrelated to the stop event, there are just to many things together here.

Can you see if live migration w/ disk do work?
Comment 15 Jaroslav Henner 2011-09-19 13:28:54 UTC 
Live migrations with disk works, but there are some problems as well sometimes (machine gets paused for example).

Kernel logs follows. I'm not sure which host was src and which was a dest, but I can find it out if you'd like.
Sep 15 17:32:30 srh-08 qemu-kvm: Could not find keytab file: /etc/qemu/krb5.tab: No such file or directory
Sep 15 17:32:32 srh-08 ntpd[1737]: Listening on interface #6 vnet0, fe80::fc1a:4aff:fe10:3f06#123 Enabled
Sep 15 17:35:56 srh-08 kernel: rhevm: port 2(vnet0) entering disabled state
Sep 15 17:35:56 srh-08 kernel: device vnet0 left promiscuous mode
Sep 15 17:35:56 srh-08 kernel: rhevm: port 2(vnet0) entering disabled state
Sep 15 17:35:57 srh-08 ntpd[1737]: Deleting interface #6 vnet0, fe80::fc1a:4aff:fe10:3f06#123, interface stats: received=0, sent=0, dropped=0, active_time=205 secs
Sep 15 17:37:29 srh-08 kernel: device vnet0 entered promiscuous mode
Sep 15 17:37:29 srh-08 kernel: rhevm: port 2(vnet0) entering forwarding state
Sep 15 17:37:29 srh-08 kernel: type=1400 audit(1316101049.548:8): avc:  denied  { getattr } for  pid=10781 comm="qemu-kvm" name="/" dev=0:16 ino=5767213 scontext=system_u:system_r:svirt_t:s0:c680,c901 tcontext=system_u:object_r:nfs_t:s0 tclass=filesystem
Sep 15 17:30:49 srh-08 multipathd: dm-3: remove map (uevent)
Sep 15 17:30:49 srh-08 multipathd: dm-3: devmap not registered, can't remove
Sep 15 17:30:49 srh-08 multipathd: dm-3: remove map (uevent)
Sep 15 17:30:49 srh-08 multipathd: dm-3: devmap not registered, can't remove
Sep 15 17:30:49 srh-08 multipathd: dm-3: remove map (uevent)
Sep 15 17:30:49 srh-08 multipathd: dm-3: devmap not registered, can't remove
Sep 15 17:30:49 srh-08 multipathd: dm-3: remove map (uevent)
Sep 15 17:30:49 srh-08 multipathd: dm-3: devmap not registered, can't remove
Sep 15 17:32:30 srh-08 kernel: device vnet0 entered promiscuous mode
Sep 15 17:32:30 srh-08 kernel: rhevm: port 2(vnet0) entering forwarding state
Sep 15 17:32:30 srh-08 qemu-kvm: Could not find keytab file: /etc/qemu/krb5.tab: No such file or directory
Sep 15 17:32:32 srh-08 ntpd[1737]: Listening on interface #6 vnet0, fe80::fc1a:4aff:fe10:3f06#123 Enabled
Sep 15 17:35:56 srh-08 kernel: rhevm: port 2(vnet0) entering disabled state
Sep 15 17:35:56 srh-08 kernel: device vnet0 left promiscuous mode
Sep 15 17:35:56 srh-08 kernel: rhevm: port 2(vnet0) entering disabled state
Sep 15 17:35:57 srh-08 ntpd[1737]: Deleting interface #6 vnet0, fe80::fc1a:4aff:fe10:3f06#123, interface stats: received=0, sent=0, dropped=0, active_time=205 secs
Sep 15 17:37:29 srh-08 kernel: device vnet0 entered promiscuous mode
Sep 15 17:37:29 srh-08 kernel: rhevm: port 2(vnet0) entering forwarding state
Sep 15 17:37:29 srh-08 kernel: type=1400 audit(1316101049.548:8): avc:  denied  { getattr } for  pid=10781 comm="qemu-kvm" name="/" dev=0:16 ino=5767213 scontext=system_u:system_r:svirt_t:s0:c680,c901 tcontext=system_u:object_r:nfs_t:s0 tclass=filesystem
Sep 15 17:37:29 srh-08 qemu-kvm: Could not find keytab file: /etc/qemu/krb5.tab: No such file or directory
Sep 15 17:37:30 srh-08 kernel: type=1400 audit(1316101050.570:9): avc:  denied  { getattr } for  pid=10781 comm="qemu-kvm" name="/" dev=0:16 ino=5767213 scontext=system_u:system_r:svirt_t:s0:c680,c901 tcontext=system_u:object_r:nfs_t:s0 tclass=filesystem
Sep 15 17:37:30 srh-08 kernel: vmx_handle_exit: unexpected, valid vectoring info (0x80000008) and exit reason is 0x80000021
Sep 15 17:37:32 srh-08 ntpd[1737]: Listening on interface #7 vnet0, fe80::fc1a:4aff:fe10:3f06#123 Enabled
Sep 15 17:40:01 srh-08 kernel: type=1400 audit(1316101201.243:10): avc:  denied  { getattr } for  pid=13274 comm="logrotate" path="/etc/logrotate.d/libvirtd" dev=dm-0 ino=1703968 scontext=system_u:system_r:logrotate_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:initrc_tmp_t:s0 tclass=file
Sep 15 17:40:45 srh-08 kernel: rhevm: port 2(vnet0) entering disabled state
Sep 15 17:40:45 srh-08 kernel: device vnet0 left promiscuous mode
Sep 15 17:40:45 srh-08 kernel: rhevm: port 2(vnet0) entering disabled state
Sep 15 17:40:46 srh-08 ntpd[1737]: Deleting interface #7 vnet0, fe80::fc1a:4aff:fe10:3f06#123, interface stats: received=0, sent=0, dropped=0, active_time=194 secs


Sep 15 17:30:49 srh-01 kernel: scsi 4:0:10:0: Direct-Access     IBM-ESXS ST9146852SS      B629 PQ: 0 ANSI: 5
Sep 15 17:30:49 srh-01 kernel: scsi 4:0:11:0: Direct-Access     IBM-ESXS ST9146852SS      B629 PQ: 0 ANSI: 5
Sep 15 17:30:49 srh-01 kernel: device-mapper: table: 253:3: multipath: error getting device
Sep 15 17:30:49 srh-01 kernel: device-mapper: ioctl: error adding target to table
Sep 15 17:30:49 srh-01 kernel: device-mapper: table: 253:3: multipath: error getting device
Sep 15 17:30:49 srh-01 kernel: device-mapper: ioctl: error adding target to table
Sep 15 17:30:49 srh-01 multipathd: dm-3: remove map (uevent)
Sep 15 17:30:49 srh-01 multipathd: dm-3: devmap not registered, can't remove
Sep 15 17:30:49 srh-01 multipathd: dm-3: remove map (uevent)
Sep 15 17:30:49 srh-01 multipathd: dm-3: devmap not registered, can't remove
Sep 15 17:30:49 srh-01 multipathd: dm-3: remove map (uevent)
Sep 15 17:30:49 srh-01 multipathd: dm-3: devmap not registered, can't remove
Sep 15 17:30:49 srh-01 multipathd: dm-3: remove map (uevent)
Sep 15 17:30:49 srh-01 multipathd: dm-3: devmap not registered, can't remove
Sep 15 17:31:22 srh-01 kernel: device vnet0 entered promiscuous mode
Sep 15 17:31:22 srh-01 kernel: rhevm: port 2(vnet0) entering forwarding state
Sep 15 17:31:22 srh-01 qemu-kvm: Could not find keytab file: /etc/qemu/krb5.tab: No such file or directory
Sep 15 17:31:25 srh-01 ntpd[2282]: Listening on interface #17 vnet0, fe80::fc1a:4aff:fe10:3f06#123 Enabled
Sep 15 17:32:33 srh-01 kernel: rhevm: port 2(vnet0) entering disabled state
Sep 15 17:32:33 srh-01 kernel: device vnet0 left promiscuous mode
Sep 15 17:32:33 srh-01 kernel: rhevm: port 2(vnet0) entering disabled state
Sep 15 17:32:35 srh-01 ntpd[2282]: Deleting interface #17 vnet0, fe80::fc1a:4aff:fe10:3f06#123, interface stats: received=0, sent=0, dropped=0, active_time=70 secs
Sep 15 17:34:39 srh-01 dhclient[1746]: DHCPREQUEST on usb0 to 169.254.95.118 port 67 (xid=0x2430c761)
Sep 15 17:34:39 srh-01 dhclient[1746]: DHCPACK from 169.254.95.118 (xid=0x2430c761)
Sep 15 17:34:39 srh-01 dhclient[1746]: bound to 169.254.95.120 -- renewal in 255 seconds.
Sep 15 17:36:13 srh-01 kernel: device vnet0 entered promiscuous mode
Sep 15 17:36:13 srh-01 kernel: rhevm: port 2(vnet0) entering forwarding state
Sep 15 17:36:13 srh-01 kernel: type=1400 audit(1316100973.652:30): avc:  denied  { getattr } for  pid=11812 comm="qemu-kvm" name="/" dev=0:17 ino=5767213 scontext=system_u:system_r:svirt_t:s0:c413,c857 tcontext=system_u:object_r:nfs_t:s0 tclass=filesystem
Sep 15 17:36:13 srh-01 qemu-kvm: Could not find keytab file: /etc/qemu/krb5.tab: No such file or directory
Sep 15 17:36:16 srh-01 ntpd[2282]: Listening on interface #18 vnet0, fe80::fc1a:4aff:fe10:3f06#123 Enabled
Sep 15 17:37:32 srh-01 kernel: rhevm: port 2(vnet0) entering disabled state
Sep 15 17:37:32 srh-01 kernel: device vnet0 left promiscuous mode
Sep 15 17:37:32 srh-01 kernel: rhevm: port 2(vnet0) entering disabled state
Sep 15 17:37:33 srh-01 ntpd[2282]: Deleting interface #18 vnet0, fe80::fc1a:4aff:fe10:3f06#123, interface stats: received=0, sent=0, dropped=0, active_time=77 secs
Sep 15 17:38:54 srh-01 dhclient[1746]: DHCPREQUEST on usb0 to 169.254.95.118 port 67 (xid=0x2430c761)
Sep 15 17:38:54 srh-01 dhclient[1746]: DHCPACK from 169.254.95.118 (xid=0x2430c761)
Sep 15 17:38:54 srh-01 dhclient[1746]: bound to 169.254.95.120 -- renewal in 252 seconds.
Sep 15 17:40:01 srh-01 kernel: type=1400 audit(1316101201.421:31): avc:  denied  { getattr } for  pid=12175 comm="logrotate" path="/etc/logrotate.d/libvirtd" dev=dm-0 ino=1835709 scontext=system_u:system_r:logrotate_t:s0-s0:c0.c1023 tcontext=unconfined_u:object_r:initrc_tmp_t:s0 tclass=file
Sep 15 17:43:06 srh-01 dhclient[1746]: DHCPREQUEST on usb0 to 169.254.95.118 port 67 (xid=0x2430c761)
Sep 15 17:43:06 srh-01 dhclient[1746]: DHCPACK from 169.254.95.118 (xid=0x2430c761)
Sep 15 17:43:06 srh-01 dhclient[1746]: bound to 169.254.95.120 -- renewal in 285 seconds.
Sep 15 17:47:51 srh-01 dhclient[1746]: DHCPREQUEST on usb0 to 169.254.95.118 port 67 (xid=0x2430c761)
Sep 15 17:47:51 srh-01 dhclient[1746]: DHCPACK from 169.254.95.118 (xid=0x2430c761)
Comment 16 Orit Wasserman 2011-09-21 12:24:16 UTC 
I need some more details on the setup:
kernel version ?
Qemu version ?

I can see it is an Intel machine , can you provide the processor details ?
Comment 17 Jaroslav Henner 2011-09-22 14:43:47 UTC 
One is 
model name	: Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm arat epb tpr_shadow vnmi flexpriority ept vpid

Second is 
model name	: Intel(R) Core(TM)2 Quad CPU    Q8400  @ 2.66GHz
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm sse4_1 xsave lahf_lm tpr_shadow vnmi flexpriority

kernel-2.6.32-131.12.1.el6.x86_64
qemu-kvm 2:0.12.1.2-2.184.el6.x86_64
Comment 18 Orit Wasserman 2011-09-27 08:35:06 UTC 
Hi,
I need the guest cpuinfo, with the same qemu command line from both the src and the destination.
Comment 19 Orit Wasserman 2011-09-28 08:12:18 UTC 
Can you try to reproduce but this time with "-cpu core2duo" ?
Comment 21 Jaroslav Henner 2011-10-20 14:34:57 UTC 
(In reply to comment #19)
> Can you try to reproduce but this time with "-cpu core2duo" ?

Reproduced. (I had hardcode core2duo to /usr/share/vdsm/libvirtvm.py.)

qemu     11134  3.3  0.2 1584616 20748 ?       Sl   16:30   0:00 /usr/libexec/qemu-kvm -S -M rhel6.2.0 -cpu core2duo -enable-kvm -m 1024 -smp 2,sockets=1,cores=2,threads=1 -name fdsa -uuid eeb93d66-60ff-41cb-aa6e-60b90ae4a827 -smbios type=1,manufacturer=Red Hat,product=RHEL,version=6Server-6.2.0.2.el6,serial=44454C4C-5800-1058-8059-C8C04F5A344A_84:2B:2B:BC:A5:D2,uuid=eeb93d66-60ff-41cb-aa6e-60b90ae4a827 -nodefconfig -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/fdsa.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=2011-10-20T14:30:54,driftfix=slew -no-shutdown -device virtio-serial-pci,id=virtio-serial0,max_ports=16,bus=pci.0,addr=0x5 -drive file=/rhev/data-center/9fd4e2db-10a3-417b-98c1-1b59fa53698c/b380d451-173e-4d56-a878-1eea583d5f31/images/25745f48-8625-4878-96fd-6a44cec8e80c/ceafb12d-c013-4b5d-a78e-4bb449abed6b,if=none,id=drive-virtio-disk0,format=raw,serial=78-96fd-6a44cec8e80c,cache=none,werror=stop,rerror=stop,aio=threads -device virtio-blk-pci,bus=pci.0,addr=0x6,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -drive if=none,media=cdrom,id=drive-ide0-1-0,readonly=on,format=raw -device ide-drive,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0 -netdev tap,fd=30,id=hostnet0,vhost=on,vhostfd=31 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=00:1a:4a:10:3f:0c,bus=pci.0,addr=0x3 -chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/fdsa.com.redhat.rhevm.vdsm,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm -chardev spicevmc,id=charchannel1,name=vdagent -device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=com.redhat.spice.0 -usb -spice port=5900,tls-port=5901,addr=0,x509-dir=/etc/pki/vdsm/libvirt-spice,tls-channel=main,tls-channel=inputs -k en-us -vga qxl -global qxl-vga.vram_size=67108864 -device intel-hda,id=sound0,bus=pci.0,addr=0x4 -device hda-duplex,id=sound0-codec0,bus=sound0.0,cad=0 -incoming tcp:0.0.0.0:49156
Comment 22 Orit Wasserman 2011-10-21 07:49:14 UTC 
Can you attach qemu and the kernel logs please ?
Comment 23 Jaroslav Henner 2011-10-21 11:10:14 UTC 
Created attachment 529475 [details]
qemu+messages logs

The machine got paused after migration command issued at 12:21:00.
Comment 24 Orit Wasserman 2011-10-24 07:53:34 UTC 
(In reply to comment #23)
> Created attachment 529475 [details]
> qemu+messages logs
> 
> The machine got paused after migration command issued at 12:21:00.
I see in the log that "-cpu Conroe" I asked to try and reproduce with "-cpu core2duo".
Comment 25 Orit Wasserman 2011-12-08 09:35:44 UTC 
Any progress ?
Comment 26 Yaniv Kaul 2012-05-21 14:30:20 UTC 
- Should be closed with INSUFFICIENT_DATA (fixed).
- I assume VirtQE tried to reproduce it as well?
Comment 27 Petr Dufek 2012-05-31 10:44:11 UTC 
Today reproduced.

All required logs are attached.

On src machine file /usr/share/vdsm/libvirtvm.py was changed on line 697:       
        model = features[0]
      + model = "core2duo"
        cpu = self.doc.createElement('cpu')


output of ps (from dst machine):
--------------------------------
[root@srh-08 ~]# ps aux | grep qemu
qemu     15634  0.9  0.5 988172 19224 ?        Sl   06:20   0:01 /usr/libexec/qemu-kvm -S -M rhel6.3.0 -cpu core2duo -enable-kvm -m 512 -smp 1,sockets=1,cores=1,threads=1 -name pausing_vm -uuid 7695b220-a853-47ee-b760-95fe3bf93e25 -smbios type=1,manufacturer=Red Hat,product=RHEV Hypervisor,version=6Server-6.3.0.2.el6,serial=FF094200-0B8C-384C-AE3C-22802EC26045_E4:1F:13:69:C4:74,uuid=7695b220-a853-47ee-b760-95fe3bf93e25 -nodefconfig -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/pausing_vm.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=2012-05-31T10:20:14,driftfix=slew -no-shutdown -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device virtio-serial-pci,id=virtio-serial0,bus=pci.0,addr=0x5 -drive if=none,media=cdrom,id=drive-ide0-1-0,readonly=on,format=raw,serial= -device ide-drive,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0 -netdev tap,fd=28,id=hostnet0,vhost=on,vhostfd=29 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=00:1a:4a:d0:3f:49,bus=pci.0,addr=0x3,bootindex=1 -chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/pausing_vm.com.redhat.rhevm.vdsm,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm -chardev spicevmc,id=charchannel1,name=vdagent -device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=com.redhat.spice.0 -chardev pty,id=charconsole0 -device virtconsole,chardev=charconsole0,id=console0 -spice port=5900,tls-port=5901,addr=0,x509-dir=/etc/pki/vdsm/libvirt-spice,tls-channel=main,tls-channel=inputs -k en-us -vga qxl -global qxl-vga.vram_size=67108864 -device intel-hda,id=sound0,bus=pci.0,addr=0x4 -device hda-duplex,id=sound0-codec0,bus=sound0.0,cad=0 -incoming tcp:0.0.0.0:49155


cpu info (from src):
--------------------
model name      : Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz
flags           : fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm arat epb dts tpr_shadow vnmi flexpriority ept vpid


cpu info (from dst):
--------------------
model name      : Intel(R) Core(TM)2 Quad CPU    Q8400  @ 2.66GHz
flags           : fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm sse4_1 xsave lahf_lm dts tpr_shadow vnmi flexpriority


software versions (from src):
-----------------------------
kernel-2.6.32-262.el6.x86_64
qemu-kvm-0.12.1.2-2.272.el6.x86_64


software versions (from dst):
-----------------------------
qemu-kvm-0.12.1.2-2.290.el6.x86_64
kernel-2.6.32-272.el6.x86_64
Comment 28 Petr Dufek 2012-05-31 10:45:40 UTC 
Created attachment 588032 [details]
Required logs
Comment 29 Petr Dufek 2012-05-31 11:09:59 UTC 
additional info:

software versions (from src):
-----------------------------
vdsm-4.9.6-9.el6.x86_64
libvirt-0.9.10-11.el6.x86_64

software versions (from dst):
-----------------------------
vdsm-4.9.6-9.el6.x86_64
libvirt-0.9.10-17.el6.x86_64
Comment 30 Orit Wasserman 2012-05-31 11:23:46 UTC 
This looks similar to this BZ:
https://bugzilla.redhat.com/show_bug.cgi?id=756044
Comment 31 Orit Wasserman 2012-07-10 11:37:41 UTC 
Can you see if the fix for 756044 fixes the issue ?
Comment 32 Orit Wasserman 2012-08-08 13:38:06 UTC 
As it looks like the same behavior duplicating.

*** This bug has been marked as a duplicate of bug 756044 ***