Bug 826575 - VM suspend leads to paused state instead of suspended
Summary: VM suspend leads to paused state instead of suspended
Keywords:
Status: CLOSED INSUFFICIENT_DATA
Alias: None
Product: oVirt
Classification: Retired
Component: vdsm
Version: unspecified
Hardware: x86_64
OS: Linux
high
high
Target Milestone: ---
: ---
Assignee: Dan Kenigsberg
QA Contact:
URL:
Whiteboard: virt
Depends On:
Blocks: 837003
TreeView+ depends on / blocked
 
Reported: 2012-05-30 14:29 UTC by Petr Dufek
Modified: 2013-08-19 10:28 UTC (History)
12 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
: 837003 (view as bug list)
Environment:
Last Closed: 2013-08-19 10:28:07 UTC
oVirt Team: ---
Embargoed:


Attachments (Terms of Use)
full log & testcase (88.98 KB, application/x-gzip)
2012-05-30 14:29 UTC, Petr Dufek
no flags Details
vdsm & libvirtd logs (1.62 MB, application/x-gzip)
2012-06-13 12:20 UTC, Petr Dufek
no flags Details

Description Petr Dufek 2012-05-30 14:29:53 UTC
Created attachment 587745 [details]
full log & testcase

Description of problem:
when appling to suspend VM this error appers (and machine ends in paused state):

Thread-1245::ERROR::2012-05-29 16:34:55,565::vm::176::vm.Vm::(_recover) vmId=`7d1605f4-7d0b-496c-af52-74e63934d7d5`::unable to close /rhev/data-center/3c3bb676-a5a7-4f9c-8e2a-3ff2cc505285/3e91a341-f773-44b3-89f2-ce2e97672b6f/images/f8ecb0c2-9218-40fb-a31d-27e8dc93a3f8/f4619812-e573-495f-a1f8-1ef05934ad2e: Input/output error
Thread-1245::ERROR::2012-05-29 16:34:55,565::vm::821::vm.Vm::(cont) vmId=`7d1605f4-7d0b-496c-af52-74e63934d7d5`::cannot cont while Saving State
Thread-1245::ERROR::2012-05-29 16:34:55,576::vm::240::vm.Vm::(run) vmId=`7d1605f4-7d0b-496c-af52-74e63934d7d5`::Failed to migrate
Traceback (most recent call last):
  File "/usr/share/vdsm/vm.py", line 223, in run
    self._startUnderlyingMigration()
  File "/usr/share/vdsm/libvirtvm.py", line 409, in _startUnderlyingMigration
    self._vm._dom.save(fname)
  File "/usr/share/vdsm/libvirtvm.py", line 491, in f
    ret = attr(*args, **kwargs)
  File "/usr/lib/python2.6/site-packages/vdsm/libvirtconnection.py", line 82, in wrapper
    ret = f(*args, **kwargs)
  File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1215, in save
    if ret == -1: raise libvirtError ('virDomainSave() failed', dom=self)
libvirtError: unable to close /rhev/data-center/3c3bb676-a5a7-4f9c-8e2a-3ff2cc505285/3e91a341-f773-44b3-89f2-ce2e97672b6f/images/f8ecb0c2-9218-40fb-a31d-27e8dc93a3f8/f4619812-e573-495f-a1f8-1ef05934ad2e: Input/output error
Thread-1247::DEBUG::2012-05-29 16:34:55,662::BindingXMLRPC::864::vds::(wrapper) client [10.35.16.225]::call vmGetStats with ('7d1605f4-7d0b-496c-af52-74e63934d7d5',) {}


Additional info:
Attached is full log & testcase

Comment 1 Dan Kenigsberg 2012-05-30 14:33:05 UTC
vdsm version? is it nfs or block domain?
since you pinpoint a libvirtError - could you attach relevant part of libvirtd.log, and mention libvirt version?

Comment 2 Petr Dufek 2012-06-13 12:19:13 UTC
- NFS storage was used

software versions:
------------------
vdsm-4.9.6-16.0.el6.x86_64
libvirt-0.9.10-21.el6.x86_64

from vdsm.log:
--------------
Thread-1319::ERROR::2012-06-13 14:52:36,483::vm::176::vm.Vm::(_recover) vmId=`73594152-cec5-4115-9357-a1b805945e04`::unable to close /rhev/data-center/61285a30-7edd-467a-8596-ce62bb4f3d44/602a3739-d688-4471-ae17-47007e18154b/images/6a21b667-da7e-4bdc-a8fd-e35dfc6bc9bf/3909323e-ecd3-4bd2-97ee-7314f460d49c: Input/output error
Thread-1319::ERROR::2012-06-13 14:52:36,483::vm::821::vm.Vm::(cont) vmId=`73594152-cec5-4115-9357-a1b805945e04`::cannot cont while Saving State
Thread-1319::ERROR::2012-06-13 14:52:36,589::vm::240::vm.Vm::(run) vmId=`73594152-cec5-4115-9357-a1b805945e04`::Failed to migrate
Traceback (most recent call last):
  File "/usr/share/vdsm/vm.py", line 223, in run
    self._startUnderlyingMigration()
  File "/usr/share/vdsm/libvirtvm.py", line 409, in _startUnderlyingMigration
    self._vm._dom.save(fname)
  File "/usr/share/vdsm/libvirtvm.py", line 491, in f
    ret = attr(*args, **kwargs)
  File "/usr/lib/python2.6/site-packages/vdsm/libvirtconnection.py", line 82, in wrapper
    ret = f(*args, **kwargs)
  File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1215, in save
    if ret == -1: raise libvirtError ('virDomainSave() failed', dom=self)
libvirtError: unable to close /rhev/data-center/61285a30-7edd-467a-8596-ce62bb4f3d44/602a3739-d688-4471-ae17-47007e18154b/images/6a21b667-da7e-4bdc-a8fd-e35dfc6bc9bf/3909323e-ecd3-4bd2-97ee-7314f460d49c: Input/output error
Thread-1322::DEBUG::2012-06-13 14:52:37,530::BindingXMLRPC::864::vds::(wrapper) client [10.35.16.189]::call vmGetStats with ('73594152-cec5-4115-9357-a1b805945e04',) {}
Thread-1322::DEBUG::2012-06-13 14:52:37,530::libvirtvm::240::vm.Vm::(_getDiskStats) vmId=`73594152-cec5-4115-9357-a1b805945e04`::Disk hdc stats not available

from libvirtd.log:
------------------
2012-06-13 11:52:36.331+0000: 2215: debug : qemuMonitorUnref:210 : QEMU_MONITOR_UNREF: mon=0x7f821800b800 refs=3
2012-06-13 11:52:36.331+0000: 2225: debug : qemuMonitorUnref:210 : QEMU_MONITOR_UNREF: mon=0x7f821800b800 refs=2
2012-06-13 11:52:36.420+0000: 2225: debug : virStorageFileIsSharedFSType:1031 : Check if path /rhev/data-center/61285a30-7edd-467a-8596-ce62bb4f3d44/602a3739-d688-4471-ae17-47007e18154b/images/6a21b667-da7e-4bdc-a8fd-e35dfc6bc9bf/3909323e-ecd3-4bd2-97ee-7314f460d49c with FS magic 26985 is shared
2012-06-13 11:52:36.421+0000: 2225: error : qemuDomainSaveInternal:2722 : unable to close /rhev/data-center/61285a30-7edd-467a-8596-ce62bb4f3d44/602a3739-d688-4471-ae17-47007e18154b/images/6a21b667-da7e-4bdc-a8fd-e35dfc6bc9bf/3909323e-ecd3-4bd2-97ee-7314f460d49c: Input/output error
2012-06-13 11:52:36.421+0000: 2225: debug : qemuDomainObjEndAsyncJob:887 : Stopping async job: save
2012-06-13 11:52:36.465+0000: 2225: debug : virDomainFree:2313 : dom=0x7f821800b060, (VM: name=restvm_basic_operations, uuid=73594152-cec5-4115-9357-a1b805945e04)
2012-06-13 11:52:36.487+0000: 2224: debug : virDomainGetXMLDesc:4379 : dom=0x7f822400e880, (VM: name=restvm_basic_operations, uuid=73594152-cec5-4115-9357-a1b805945e04), flags=0


new vdsm.log & corresponding libvirtd.log are attached

Comment 3 Petr Dufek 2012-06-13 12:20:01 UTC
Created attachment 591466 [details]
vdsm & libvirtd logs

Comment 4 Michal Skrivanek 2012-07-31 14:32:23 UTC
why is this a regression?
What do we expect the VM to do in case of disk io error/out of space?

Comment 5 Yaniv Kaul 2012-07-31 14:35:13 UTC
(In reply to comment #4)
> why is this a regression?

It worked in 3.0.

> What do we expect the VM to do in case of disk io error/out of space?

To pause. But I do wonder why we get an IO error. Petr - any idea? Anything in VDSM log?

Comment 6 Petr Dufek 2012-08-01 14:27:29 UTC
actually not, but will arrange the machine with this simulated tomorrow and will contact Michal Skrivanek offline to have a look directly on the machine.

Comment 7 Michal Skrivanek 2012-09-24 07:26:29 UTC
(In reply to comment #6)
> actually not, but will arrange the machine with this simulated tomorrow and
> will contact Michal Skrivanek offline to have a look directly on the machine.
any update?

Comment 9 Michal Skrivanek 2013-08-19 10:28:07 UTC
the behavior seems to be ok, nevertheless no update for a looong time...


Note You need to log in before you can comment on or make changes to this bug.