Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 927167

Summary: [nova] live-migration to an invalid host should exist gracefully. Currently, it throws a stack trace
Product: Red Hat OpenStack Reporter: Kashyap Chamarthy <kchamart>
Component: openstack-novaAssignee: Nikola Dipanov <ndipanov>
Status: CLOSED ERRATA QA Contact: Omri Hochman <ohochman>
Severity: medium Docs Contact:
Priority: medium    
Version: 2.0 (Folsom)CC: eglynn, ndipanov, ykaul
Target Milestone: asyncKeywords: Rebase, Triaged
Target Release: 2.1   
Hardware: Unspecified   
OS: Linux   
Whiteboard:
Fixed In Version: openstack-nova-2012.2.4-1.el6ost Doc Type: Rebase: Bug Fixes and Enhancements
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2013-05-09 13:54:52 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 950133    
Bug Blocks:    

Description Kashyap Chamarthy 2013-03-25 09:20:20 UTC
Description of problem: live migrating to an invalid host throws a stack trace.


Version-Release number of selected component (if applicable):

openstack-nova-compute-2012.2.3-7.el6ost.noarch

How reproducible:
Always

Steps to Reproduce:
1. Configure nova, boot a couple of instances, & migrate any instance to a destination (which is invalid -- no compute service on it)

   $ nova live-migration 6fdcafa3-b86b-479e-b1cf-5e6859912e65 maelstrom.lab.eng.pnq.redhat.com

  
Actual results:

An ungraceful bad stack trace:
#============================#
$ nova live-migration 6fdcafa3-b86b-479e-b1cf-5e6859912e65 maelstrom.lab.eng.pnq.redhat.com
ERROR: Compute service of maelstrom.lab.eng.pnq.redhat.com is unavailable at this time.
Traceback (most recent call last):

  File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/amqp.py", line 276, in _process_data
    rval = self.proxy.dispatch(ctxt, version, method, **args)

  File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/dispatcher.py", line 145, in dispatch
    return getattr(proxyobj, method)(ctxt, **kwargs)

  File "/usr/lib/python2.6/site-packages/nova/scheduler/manager.py", line 101, in live_migration
    context, ex, request_spec)

  File "/usr/lib64/python2.6/contextlib.py", line 23, in __exit__
    self.gen.next()

  File "/usr/lib/python2.6/site-packages/nova/scheduler/manager.py", line 91, in live_migration
    block_migration, disk_over_commit)

  File "/usr/lib/python2.6/site-packages/nova/scheduler/driver.py", line 232, in schedule_live_migration
    self._live_migration_dest_check(context, instance, dest)

  File "/usr/lib/python2.6/site-packages/nova/scheduler/driver.py", line 281, in _live_migration_dest_check
    raise exception.ComputeServiceUnavailable(host=dest)

ComputeServiceUnavailable: Compute service of maelstrom.lab.eng.pnq.redhat.com is unavailable at this time.
 (HTTP 400) (Request-ID: req-248afb33-a9ed-4c68-822a-7dac6bc76cb3)
#============================#

Expected results:

If the destination host is invalid, live-migration should exist gracefully


Additional info:
Nikola Dipanov was also able to reproduce this on Grizzly.

Comment 2 Nikola Dipanov 2013-03-25 11:02:36 UTC
This seems like the problem with how the API service interprets the exceptions sent back from the scheduler. It is present in the current trunk (grizzly-RC1), so we should fix this upstream first.

Comment 3 Kashyap Chamarthy 2013-03-26 09:03:43 UTC
Link to upstream bz -- https://bugs.launchpad.net/bugs/1159755

Comment 4 Nikola Dipanov 2013-03-26 14:58:46 UTC
Fix proposed upstream: https://review.openstack.org/#/c/25388/

Comment 8 Omri Hochman 2013-05-05 08:35:47 UTC
Verified openstack-nova-2012.2.4-4.el6ost. 

nova live-migration falls gracefully without displaying :   'Traceback (most recent call last):' 

[root@puma01 /(keystone_admin)]$ nova live-migration  a49d4473-ea42-4d5b-9a30-cedd27aaf7ce puma05.scl.lab.tlv.redhat.com
ERROR: Compute service of puma05.scl.lab.tlv.redhat.com is unavailable at this time. (HTTP 400) (Request-ID: req-d72e873c-2ccb-4724-9259-ea617453fa33)
[root@puma01 /(keystone_admin)]$

Comment 9 errata-xmlrpc 2013-05-09 13:54:52 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

http://rhn.redhat.com/errata/RHBA-2013-0798.html