Bug 1544203

Summary: Shutdown VM action fails and VM becomes non-responding
Product: Red Hat Enterprise Linux 7 Reporter: Liran Rotenberg <lrotenbe>
Component: libvirtAssignee: Libvirt Maintainers <libvirt-maint>
Status: CLOSED DUPLICATE QA Contact: Fangge Jin <fjin>
Severity: urgent Docs Contact:
Priority: unspecified    
Version: 7.4CC: bugs, chhu, dyuan, jiyan, libvirt-maint, lmen, lrotenbe, ratamir, rbalakri, xuzhang
Target Milestone: rcKeywords: Regression
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-02-12 07:47:10 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Virt RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
logs none

Description Liran Rotenberg 2018-02-11 09:22:43 UTC
Created attachment 1394522 [details]
logs

Description of problem:
When shutting down a VM(RHEL/Windows) the VM shutdown fails and the VM enters to non-responding state.

from vdsm log:
2018-02-11 10:06:26,406+0200 WARN  (vdsm.Scheduler) [Executor] Worker blocked: <Worker name=periodic/14 running <Task <Operation action=<vdsm.virt.sampling.HostMonitor object at 0x7fa9d00f5690> at 0x7fa9d00f56d0
> timeout=15, duration=135 at 0x7fa985d06cd0> task#=47157 at 0x7fa9d00cf590>, traceback:
File: "/usr/lib64/python2.7/threading.py", line 785, in __bootstrap
  self.__bootstrap_inner()
File: "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner
  self.run()
File: "/usr/lib64/python2.7/threading.py", line 765, in run
  self.__target(*self.__args, **self.__kwargs)
File: "/usr/lib/python2.7/site-packages/vdsm/common/concurrent.py", line 194, in run
  ret = func(*args, **kwargs)
File: "/usr/lib/python2.7/site-packages/vdsm/executor.py", line 301, in _run
  self._execute_task()
File: "/usr/lib/python2.7/site-packages/vdsm/executor.py", line 315, in _execute_task
  task()
File: "/usr/lib/python2.7/site-packages/vdsm/executor.py", line 391, in __call__
  self._callable()
File: "/usr/lib/python2.7/site-packages/vdsm/virt/periodic.py", line 213, in __call__
  self._func()
File: "/usr/lib/python2.7/site-packages/vdsm/virt/sampling.py", line 578, in __call__
  stats = hostapi.get_stats(self._cif, self._samples.stats())
File: "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 62, in get_stats
  avail, commit = _memUsageInfo(cif)
File: "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 121, in _memUsageInfo
  mem_info = v.memory_info()
File: "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 814, in memory_info
  dom_stats = self._dom.memoryStats()
File: "/usr/lib/python2.7/site-packages/vdsm/virt/virdomain.py", line 98, in f
  ret = attr(*args, **kwargs)
File: "/usr/lib/python2.7/site-packages/vdsm/common/libvirtconnection.py", line 130, in wrapper
  ret = f(*args, **kwargs)
File: "/usr/lib/python2.7/site-packages/vdsm/common/function.py", line 92, in wrapper
  return func(inst, *args, **kwargs)
File: "/usr/lib64/python2.7/site-packages/libvirt.py", line 1510, in memoryStats
  ret = libvirtmod.virDomainMemoryStats(self._o) (executor:363)


Version-Release number of selected component (if applicable):
ovirt-engine-4.2.1.6-0.1.el7.noarch
vdsm-4.20.17-1.el7ev.x86_64
libvirt-3.9.0-7.el7.x86_64
qemu-kvm-rhev-2.10.0-19.el7.x86_64

How reproducible:
100%

Steps to Reproduce:
1. Create a VM with OS installed and guest-agent.
2. Start the VM.
3. Shutdown the VM.

Actual results:
VM looping in non-responding state and to powering-down state.

Expected results:
VM state down.

Additional information:
After the VM entered to the loop. Restarting the engine or host doesn't help to retrieve the VM to down/up state.