Created attachment 557253 [details]
logs

Description of problem:

blocking storage from host using iptables will cause the vm running on hsm host to shut down 

Version-Release number of selected component (if applicable):

vdsm-4.9.3.1-0.fc16.x86_64

How reproducible:

100%

Steps to Reproduce:
1. in iscsi storage with running vm's on 2 hosts, block storage from host using iptables 
2.
3.
  
Actual results:

vm's running on hsm host will shut down 

Expected results:

vms should change state to unknown

Additional info: full logs are attached

first error: 

Thread-71::ERROR::2012-01-24 16:59:30,768::utils::393::vm.Vm::(collect) vmId=`9e160556-2e1f-4624-8edc-a7fb06e2fe09`::Stats function failed: <AdvancedStatsFunction _sampleDiskLat
ency at 0x1e28960>
Traceback (most recent call last):
  File "/usr/share/vdsm/utils.py", line 389, in collect
    statsFunction()
  File "/usr/share/vdsm/utils.py", line 266, in __call__
    retValue = self._function(*args, **kwargs)
  File "/usr/share/vdsm/libvirtvm.py", line 155, in _sampleDiskLatency
    stats = _blockstatsParses(out)
  File "/usr/share/vdsm/libvirtvm.py", line 142, in _blockstatsParses
    'flush_op':devStats['flush_operations'],
KeyError: 'flush_operations'


second error: 

Thread-53::ERROR::2012-01-24 17:04:43,590::domainMonitor::120::Storage.DomainMonitor::(_monitorDomain) Error while collecting domain `038e5836-a83a-4aa2-9fd3-77b2ee910511` monitoring information
Traceback (most recent call last):
  File "/usr/share/vdsm/storage/domainMonitor.py", line 105, in _monitorDomain
    nextStatus.readDelay = domain.getReadDelay()
  File "/usr/share/vdsm/storage/blockSD.py", line 423, in getReadDelay
    f.read(4096)
  File "/usr/share/vdsm/storage/fileUtils.py", line 287, in read
    raise OSError(err, msg)
OSError: [Errno 5] Input/output error
Thread-53::DEBUG::2012-01-24 17:04:43,593::domainMonitor::130::Storage.DomainMonitor::(_monitorDomain) Domain `038e5836-a83a-4aa2-9fd3-77b2ee910511` changed its status to Invalid
libvirtEventLoop::INFO::2012-01-24 17:04:43,605::libvirtvm::1301::vm.Vm::(_onAbnormalStop) vmId=`9e160556-2e1f-4624-8edc-a7fb06e2fe09`::abnormal vm stop device ide0-0-0 error 
libvirtEventLoop::DEBUG::2012-01-24 17:04:43,606::libvirtvm::1475::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`9e160556-2e1f-4624-8edc-a7fb06e2fe09`::event Suspended detail 2 opaque None


vm is killed:

Thread-71::ERROR::2012-01-24 17:04:59,585::utils::393::vm.Vm::(collect) vmId=`9e160556-2e1f-4624-8edc-a7fb06e2fe09`::Stats function failed: <AdvancedStatsFunction _highWrite at 0x1e27b40>
Traceback (most recent call last):
  File "/usr/share/vdsm/utils.py", line 389, in collect
    statsFunction()
  File "/usr/share/vdsm/utils.py", line 266, in __call__
    retValue = self._function(*args, **kwargs)
  File "/usr/share/vdsm/libvirtvm.py", line 79, in _highWrite
    self._vm._dom.blockInfo(vmDrive.path, 0)
  File "/usr/share/vdsm/libvirtvm.py", line 483, in f
    ret = attr(*args, **kwargs)
  File "/usr/share/vdsm/libvirtconnection.py", line 79, in wrapper
    ret = f(*args, **kwargs)
  File "/usr/lib64/python2.7/site-packages/libvirt.py", line 1383, in blockInfo
    if ret is None: raise libvirtError ('virDomainGetBlockInfo() failed', dom=self)
libvirtError: Unable to read from monitor: Connection reset by peer
libvirtEventLoop::DEBUG::2012-01-24 17:04:59,587::libvirtvm::1475::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`9e160556-2e1f-4624-8edc-a7fb06e2fe09`::event Stopped detail 5 opaque None
libvirtEventLoop::INFO::2012-01-24 17:04:59,589::vm::581::vm.Vm::(_onQemuDeath) vmId=`9e160556-2e1f-4624-8edc-a7fb06e2fe09`::underlying process disconnected
libvirtEventLoop::INFO::2012-01-24 17:04:59,590::libvirtvm::1360::vm.Vm::(releaseVm) vmId=`9e160556-2e1f-4624-8edc-a7fb06e2fe09`::Release VM resources
libvirtEventLoop::DEBUG::2012-01-24 17:04:59,599::utils::330::vm.Vm::(stop) vmId=`9e160556-2e1f-4624-8edc-a7fb06e2fe09`::Stop statistics collection
Thread-71::DEBUG::2012-01-24 17:04:59,600::utils::361::vm.Vm::(run) vmId=`9e160556-2e1f-4624-8edc-a7fb06e2fe09`::Stats thread finished
libvirtEventLoop::WARNING::2012-01-24 17:04:59,603::libvirtvm::1371::vm.Vm::(releaseVm) vmId=`9e160556-2e1f-4624-8edc-a7fb06e2fe09`::Traceback (most recent call last):
  File "/usr/share/vdsm/libvirtvm.py", line 1368, in releaseVm
    self._dom.destroy()
  File "/usr/share/vdsm/libvirtvm.py", line 483, in f
    ret = attr(*args, **kwargs)
  File "/usr/share/vdsm/libvirtconnection.py", line 79, in wrapper
    ret = f(*args, **kwargs)
  File "/usr/lib64/python2.7/site-packages/libvirt.py", line 553, in destroy
    if ret == -1: raise libvirtError ('virDomainDestroy() failed', dom=self)
libvirtError: Domain not found: no domain with matching uuid '9e160556-2e1f-4624-8edc-a7fb06e2fe09'