Bug 1110367

Summary: live migration failed due to no shared storage when using rbd imagebackend
Product: Red Hat OpenStack Reporter: Stephen Gordon <sgordon>
Component: openstack-novaAssignee: Pádraig Brady <pbrady>
Status: CLOSED ERRATA QA Contact: Toure Dunnon <tdunnon>
Severity: high Docs Contact:
Priority: high    
Version: 5.0 (RHEL 7)CC: ndipanov, pbrady, sclewis, slong, tdunnon, yeylon
Target Milestone: rc   
Target Release: 5.0 (RHEL 7)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: openstack-nova-2014.1-6.el6ost, openstack-nova-2014.1-7.el7ost Doc Type: Bug Fix
Doc Text:
The live migration of Ceph-backed instances (RBD image) was previously unsupported. With this update, shared storage checks have been augmented so that Ceph-backed instances can now be migrated live.
 Story Points: ---
Clone Of:
: 1115614 (view as bug list) Environment:
Last Closed: 2014-07-08 15:28:54 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1077198, 1111295, 1115614    

Description Stephen Gordon 2014-06-17 13:51:27 UTC 
Description of problem:

Cloned from LP # 1250751

I am using rbd image backend for my instance. When I perform live migratin there are some error as follows:
======================================================
2013-11-13 16:09:01.084 2610 ERROR nova.openstack.common.rpc.amqp [req-01304e20-7986-4982-925b-56e62dd07499 a043bf5308314731b6bc60a523b5c803 03b91ca8deb044ec9b32d4aff61df
973] Exception during message handling
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/amqp.py", line 426, in _process_data
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp **args)
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp result = getattr(proxyobj, method)(ctxt, **kwargs)
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/exception.py", line 99, in wrapped
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp temp_level, payload)
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp File "/usr/lib64/python2.6/contextlib.py", line 23, in __exit__
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp self.gen.next()
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/exception.py", line 76, in wrapped
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp return f(self, context, *args, **kw)
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 3609, in check_can_live_migrate_
destination
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp dest_check_data)
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/rpcapi.py", line 274, in check_can_live_migrate_so
urce
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp instance))
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/proxy.py", line 126, in call
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp result = rpc.call(context, real_topic, msg, timeout)
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/__init__.py", line 140, in call
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp return _get_impl().call(CONF, context, topic, msg, timeout)
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/impl_kombu.py", line 824, in call
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp rpc_amqp.get_connection_pool(conf, Connection))
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/amqp.py", line 539, in call
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp rv = list(rv)
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/amqp.py", line 504, in __iter__
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp raise result
2013-11-13 16:09:01.084 2610 TRACE nova.openstack.common.rpc.amqp InvalidSharedStorage_Remote: ymy-r1-7 is not on shared storage: Live migration can not be used without s
hared storage.
======================================================

I use only one rbd storage pool for my instances. There are shared storage actually. But the code in nova for checking shared storage do not make sence for rbd image backend.

Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:
Comment 1 Stephen Gordon 2014-06-19 20:08:35 UTC 
Hi Padraig,

Nikola is away for a few days, and today we discussed (in your absence admittedly!) the idea of you taking over a lot of the Ceph integration work going forward into Juno. Would you mind reviewing this patch upstream?

Would be good to get danpb to look at it again if he has time too. Thanks!
Comment 3 Pádraig Brady 2014-06-20 14:20:32 UTC 
I've +2'd that upstream. It looks correct and well polished and has been in the loop for 7 months!
Comment 4 Stephen Gordon 2014-06-20 14:31:08 UTC 
Thanks, would probably like to see some feedback from Dan as well as I know he had comments on an earlier revision.
Comment 5 Stephen Gordon 2014-06-24 14:13:49 UTC 
Hi Toure,

Are you or someone else on your team able to provide qa_ack?

Thanks,

Steve
Comment 9 errata-xmlrpc 2014-07-08 15:28:54 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

http://rhn.redhat.com/errata/RHEA-2014-0853.html