Bug 1505666 - HE vm does not get migrated when the host is moved to maintenance
Summary: HE vm does not get migrated when the host is moved to maintenance
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Red Hat Gluster Storage
Classification: Red Hat Storage
Component: rhhi
Version: rhhi-1.0
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ---
: ---
Assignee: Sahina Bose
QA Contact: RamaKasturi
URL:
Whiteboard:
: 1505669 (view as bug list)
Depends On: 1505669
Blocks: RHHI-1.1-In-Flight-BZs
TreeView+ depends on / blocked
 
Reported: 2017-10-24 06:02 UTC by RamaKasturi
Modified: 2018-01-03 10:53 UTC (History)
3 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
: 1505669 (view as bug list)
Environment:
Last Closed: 2018-01-03 10:53:21 UTC
Embargoed:


Attachments (Terms of Use)

Description RamaKasturi 2017-10-24 06:02:58 UTC
Description of problem:
When the host is moved to maintenance with out stopping gluster services i see that HE vm does not migrated to another node. If the host is which is running HE vm is SPM then moving that host to maintenance with out stopping gluster services migrates HE vm.

Version-Release number of selected component (if applicable):
Red Hat Virtualization Manager Version: 4.1.7.3-0.1.el7

How reproducible:
Always

Steps to Reproduce:
1. Install HC with latest version of RHV and glusterfs
2. Now move one of the host to maintenance with out stopping glusterd services on it.
3.

Actual results:
I see that HE vm does not get migrated to other host and the host is stuck in preparing for maintenance state forever.

Expected results:
HE vm should get migrated to another host and the host should move to maintenance.

Additional info:
This issue is found during running tier2 cases and sla cases does not proceed further with out this fix

Comment 2 RamaKasturi 2017-10-24 06:06:46 UTC
Following Traceback is seen in vdsm.log file:
============================================
2017-10-23 17:30:43,780+0530 ERROR (jsonrpc/4) [jsonrpc.JsonRpcServer] Internal server error (__init__:577)
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", line 572, in _handle_request
    res = method(**params)
  File "/usr/lib/python2.7/site-packages/vdsm/rpc/Bridge.py", line 198, in _dynamicMethod
    result = fn(*methodArgs)
  File "/usr/share/vdsm/API.py", line 1454, in getAllVmIoTunePolicies
    io_tune_policies_dict = self._cif.getAllVmIoTunePolicies()
  File "/usr/share/vdsm/clientIF.py", line 454, in getAllVmIoTunePolicies
    'current_values': v.getIoTune()}
  File "/usr/share/vdsm/virt/vm.py", line 2859, in getIoTune
    result = self.getIoTuneResponse()
  File "/usr/share/vdsm/virt/vm.py", line 2878, in getIoTuneResponse
    res = self._dom.blockIoTune(
  File "/usr/lib/python2.7/site-packages/vdsm/virt/virdomain.py", line 47, in __getattr__
    % self.vmid)
NotConnectedError: VM u'144ef346-d7e7-420f-ad54-a46d5880cb20' was not started yet or was shut down

Comment 3 RamaKasturi 2017-10-24 06:22:13 UTC
sosreports are present in the link below:
=================================================

http://rhsqe-repo.lab.eng.blr.redhat.com/sosreports/HC/1505666/

Comment 4 Denis Chaplygin 2017-11-08 13:26:32 UTC
Using a HC environment i manually migrated a HE VM to the non-SPM host and then switched that host to the maintenance mode. VM immediately started its migration and in about 6-7 minutes it migrated to another host and initial host switched to the maintenance mode.

Comment 5 RamaKasturi 2017-11-08 14:02:22 UTC
Hi Denis,

        Can you please move the host which is not an SPM and which has HE vm running to maintenance with out stopping gluster services ? 

Thanks
kasturi

Comment 6 Denis Chaplygin 2017-11-08 14:08:29 UTC
This is exactly what i did - moved non-SPM host running HE VM to the maintenance mode. VM migrated successfully

Comment 7 RamaKasturi 2017-11-08 14:15:12 UTC
Denis, i was seeing the issue with 4.1.7.3-0.1.el7

Any idea if this has been fixed with 4.1.7.4-0.1.el7 ? Since the setup where you are trying is 4.1.7.4

Comment 8 RamaKasturi 2017-11-08 14:26:41 UTC
Denis, i was seeing the issue with 4.1.7.3-0.1.el7

Any idea if this has been fixed with 4.1.7.4-0.1.el7 ? Since the setup where you are trying is 4.1.7.4

Comment 9 Denis Chaplygin 2017-11-08 14:53:04 UTC
Last change that can be related to that issue was made in May 19.

Comment 10 RamaKasturi 2017-11-15 09:02:24 UTC
Hi Denis,

   This issue was seen even with 4.1.6 builds too and artyom from the RHV team has checked this. Since we see that this is working with the latest build can we move this to on_qa saying works with the latest build ?

Thanks
kasturi.

Comment 11 Denis Chaplygin 2017-11-15 09:29:51 UTC
Definitely yes, go on!

Comment 12 RamaKasturi 2017-11-15 17:26:51 UTC
Hi Denis,

   Can you please move it to on_qa ?

Thanks
kasturi

Comment 13 Sahina Bose 2017-11-22 13:00:50 UTC
*** Bug 1505669 has been marked as a duplicate of this bug. ***

Comment 14 RamaKasturi 2017-11-29 11:08:52 UTC
Verified and works fine with build Red Hat Virtualization Manager Version: 4.1.8.1-0.1.el7

I see the Hosted engine vm migrates to another host when gluster services are not stopped while the host is moved to maintenance.


Note You need to log in before you can comment on or make changes to this bug.