Bug 1450100 - [Openstack-containers][OSP12] Add support for migration over SSH
Summary: [Openstack-containers][OSP12] Add support for migration over SSH
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: rhosp-director
Version: 12.0 (Pike)
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: Upstream M3
: 12.0 (Pike)
Assignee: Ollie Walsh
QA Contact: Alexander Chuzhoy
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2017-05-11 14:16 UTC by Ollie Walsh
Modified: 2018-02-05 19:07 UTC (History)
9 users (show)

Fixed In Version: openstack-nova-compute-docker-12.0-20171009.1 openstack-tripleo-heat-templates-7.0.1-0.20170927205938.el7ost
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2017-12-13 21:25:26 UTC
Target Upstream Version:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
OpenStack gerrit 471956 0 None MERGED Add support for nova live/cold-migration with containers 2020-08-24 05:55:47 UTC
Red Hat Product Errata RHEA-2017:3462 0 normal SHIPPED_LIVE Red Hat OpenStack Platform 12.0 Enhancement Advisory 2018-02-16 01:43:25 UTC

Description Ollie Walsh 2017-05-11 14:16:23 UTC
In a non-containerized environment, live-migration and cold-migration of instances involves relatively complex configuration to enable a secure SSH transport from one compute node to another.
Nova-compute (cold-migration) and libvirtd (live-migration) share this transport.

The current solution does not work with current containerized solution for a number of reasons and has been temporarily disabled.

Comment 3 Alexander Chuzhoy 2017-10-26 21:13:36 UTC
Live migration works after disabling selinux on compute (https://bugzilla.redhat.com/show_bug.cgi?id=1495599)
+--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+
| ID                                   | Name         | Status | Task State | Power State | Networks                             |
+--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+
| 91c1d51c-2304-44d7-b7fc-9bbb50ef93f0 | after_deploy | ACTIVE | -          | Running     | tenantvxlan=192.168.32.9, 10.0.0.193 |
+--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+

(overcloud) [stack@undercloud-0 ~]$ nova show after_deploy|grep hyper
.0.0.193| OS-EXT-SRV-ATTR:hypervisor_hostname  | overcloud-novacompute3-1.localdomain                                             |
(overcloud) [stack@undercloud-0 ~]$ ping -c1 10.0.0.193
PING 10.0.0.193 (10.0.0.193) 56(84) bytes of data.
64 bytes from 10.0.0.193: icmp_seq=1 ttl=63 time=4.89 ms

--- 10.0.0.193 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 4.892/4.892/4.892/0.000 ms
(overcloud) [stack@undercloud-0 ~]$ nova live-migration after_deploy


nova list:
+--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+
| ID                                   | Name         | Status    | Task State | Power State | Networks                             |
+--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+
| 91c1d51c-2304-44d7-b7fc-9bbb50ef93f0 | after_deploy | MIGRATING | migrating  | Running     | tenantvxlan=192.168.32.9, 10.0.0.193 |
+--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+


                                          |
(overcloud) [stack@undercloud-0 ~]$ nova list

+--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+
| ID                                   | Name         | Status | Task State | Power State | Networks                             |
+--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+
| 91c1d51c-2304-44d7-b7fc-9bbb50ef93f0 | after_deploy | ACTIVE | -          | Running     | tenantvxlan=192.168.32.9, 10.0.0.193 |
+--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+


(overcloud) [stack@undercloud-0 ~]$ nova show after_deploy|grep hyper

| OS-EXT-SRV-ATTR:hypervisor_hostname  | overcloud-novacompute1-1.localdomain                                             |



(undercloud) [stack@undercloud-0 ~]$ ssh heat-admin.24.6 "hostname; sudo virsh list"
overcloud-novacompute1-1
 Id    Name                           State
----------------------------------------------------
 1     instance-00000002              running

Comment 4 Alexander Chuzhoy 2017-10-26 21:15:23 UTC
Environment for comment #3:
openstack-tripleo-heat-templates-7.0.3-0.20171019091938.el7ost.noarch
openstack-nova-compute-16.0.2-0.20171019183942.cb3abbd.el7ost.noarch

Comment 5 Alexander Chuzhoy 2017-10-26 22:29:47 UTC
Environment:
openstack-tripleo-heat-templates-7.0.3-0.20171019091938.el7ost.noarch
openstack-nova-compute-16.0.2-0.20171019183942.cb3abbd.el7ost.noarch


(overcloud) [stack@undercloud-0 ~]$ nova list

+--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+
| ID                                   | Name         | Status | Task State | Power State | Networks                             |
+--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+
| 91c1d51c-2304-44d7-b7fc-9bbb50ef93f0 | after_deploy | ACTIVE | -          | Running     | tenantvxlan=192.168.32.9, 10.0.0.193 |
+--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+


(overcloud) [stack@undercloud-0 ~]$ nova show after_deploy 2>/dev/null|grep hypervisor
| OS-EXT-SRV-ATTR:hypervisor_hostname  | overcloud-novacompute1-1.localdomain                                             




(overcloud) [stack@undercloud-0 ~]$ nova stop after_deploy 2>/dev/null
Request to stop server after_deploy has been accepted.


(overcloud) [stack@undercloud-0 ~]$ nova list 2>/dev/null
+--------------------------------------+--------------+---------+------------+-------------+--------------------------------------+
| ID                                   | Name         | Status  | Task State | Power State | Networks                             |
+--------------------------------------+--------------+---------+------------+-------------+--------------------------------------+
| 91c1d51c-2304-44d7-b7fc-9bbb50ef93f0 | after_deploy | SHUTOFF | -          | Shutdown    | tenantvxlan=192.168.32.9, 10.0.0.193 |
+--------------------------------------+--------------+---------+------------+-------------+--------------------------------------+
(overcloud) [stack@undercloud-0 ~]$ nova show after_deploy 2>/dev/null|grep hypervisor
| OS-EXT-SRV-ATTR:hypervisor_hostname  | overcloud-novacompute1-1.localdomain                                             |
(
(overcloud) [stack@undercloud-0 ~]$ nova migrate after_deploy 


(overcloud) [stack@undercloud-0 ~]$ nova show after_deploy 2>/dev/null|grep hypervisor
| OS-EXT-SRV-ATTR:hypervisor_hostname  | overcloud-novacompute3-0.localdomain                                             |
(overcloud) [stack@undercloud-0 ~]$ nova start after_deploy
ERROR (CommandError): Unable to start the specified server(s).


(overcloud) [stack@undercloud-0 ~]$ nova list 2>/dev/null
+--------------------------------------+--------------+---------------+------------+-------------+--------------------------------------+
| ID                                   | Name         | Status        | Task State | Power State | Networks                             |
+--------------------------------------+--------------+---------------+------------+-------------+--------------------------------------+
| 91c1d51c-2304-44d7-b7fc-9bbb50ef93f0 | after_deploy | VERIFY_RESIZE | -          | Shutdown    | tenantvxlan=192.168.32.9, 10.0.0.193 |
+--------------------------------------+--------------+---------------+------------+-------------+--------------------------------------+
(overcloud) [stack@undercloud-0 ~]$ nova resize-confirm after_deploy


(overcloud) [stack@undercloud-0 ~]$ nova list 2>/dev/null
+--------------------------------------+--------------+---------+------------+-------------+--------------------------------------+
| ID                                   | Name         | Status  | Task State | Power State | Networks                             |
+--------------------------------------+--------------+---------+------------+-------------+--------------------------------------+
| 91c1d51c-2304-44d7-b7fc-9bbb50ef93f0 | after_deploy | SHUTOFF | -          | Shutdown    | tenantvxlan=192.168.32.9, 10.0.0.193 |
+--------------------------------------+--------------+---------+------------+-------------+--------------------------------------+
(overcloud) [stack@undercloud-0 ~]$ nova start after_deploy
Request to start server after_deploy has been accepted.

(overcloud) [stack@undercloud-0 ~]$ nova list 2>/dev/null
+--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+
| ID                                   | Name         | Status | Task State | Power State | Networks                             |
+--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+
| 91c1d51c-2304-44d7-b7fc-9bbb50ef93f0 | after_deploy | ACTIVE | -          | Running     | tenantvxlan=192.168.32.9, 10.0.0.193 |
+--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+



(overcloud) [stack@undercloud-0 ~]$ ping -c1 10.0.0.193
PING 10.0.0.193 (10.0.0.193) 56(84) bytes of data.
64 bytes from 10.0.0.193: icmp_seq=1 ttl=63 time=1.70 ms

--- 10.0.0.193 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.705/1.705/1.705/0.000 ms

Comment 8 Alexander Chuzhoy 2017-10-30 21:26:44 UTC
Verified
Environment:
openstack-tripleo-heat-templates-7.0.3-0.20171023134948.el7ost.noarch
openstack-nova-compute-16.0.2-0.20171023105738.a2e4540.el7ost.noarch


Checked live migration again and it worked:



(undercloud) [stack@undercloud-0 ~]$ . keystonerc_master 
(overcloud) [stack@undercloud-0 ~]$ nova list
nova +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+
| ID                                   | Name         | Status | Task State | Power State | Networks                             |
+--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+
| b263728b-3bb2-477d-aac6-548eba6a9202 | after_deploy | ACTIVE | -          | Running     | tenantvxlan=192.168.32.7, 10.0.0.190 |
+--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+
(overcloud) [stack@undercloud-0 ~]$ nova show after_deploy|grep hyper
pinc| OS-EXT-SRV-ATTR:hypervisor_hostname  | overcloud-compute-15.localdomain                                                 |
(overcloud) [stack@undercloud-0 ~]$ ping -c1 10.0.0.190
PING 10.0.0.190 (10.0.0.190) 56(84) bytes of data.
64 bytes from 10.0.0.190: icmp_seq=1 ttl=63 time=5.39 ms

--- 10.0.0.190 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 5.390/5.390/5.390/0.000 ms
(overcloud) [stack@undercloud-0 ~]$ nova live-migration after_deploy
(overcloud) [stack@undercloud-0 ~]$ nova list
+--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+
| ID                                   | Name         | Status    | Task State | Power State | Networks                             |
+--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+
| b263728b-3bb2-477d-aac6-548eba6a9202 | after_deploy | MIGRATING | migrating  | Running     | tenantvxlan=192.168.32.7, 10.0.0.190 |
+--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+
(overcloud) [stack@undercloud-0 ~]$ nova list
+--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+
| ID                                   | Name         | Status    | Task State | Power State | Networks                             |
+--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+
| b263728b-3bb2-477d-aac6-548eba6a9202 | after_deploy | MIGRATING | migrating  | Running     | tenantvxlan=192.168.32.7, 10.0.0.190 |
+--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+
(overcloud) [stack@undercloud-0 ~]$ nova list
+--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+
| ID                                   | Name         | Status    | Task State | Power State | Networks                             |
+--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+
| b263728b-3bb2-477d-aac6-548eba6a9202 | after_deploy | MIGRATING | migrating  | Running     | tenantvxlan=192.168.32.7, 10.0.0.190 |
+--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+
(overcloud) [stack@undercloud-0 ~]$ nova list
+--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+
| ID                                   | Name         | Status | Task State | Power State | Networks                             |
+--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+
| b263728b-3bb2-477d-aac6-548eba6a9202 | after_deploy | ACTIVE | -          | Running     | tenantvxlan=192.168.32.7, 10.0.0.190 |
+--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+
(overcloud) [stack@undercloud-0 ~]$ nova show after_deploy|grep hyper
| OS-EXT-SRV-ATTR:hypervisor_hostname  | overcloud-compute-14.localdomain                                                 |
(overcloud) [stack@undercloud-0 ~]$ ping -c1 10.0.0.190
PING 10.0.0.190 (10.0.0.190) 56(84) bytes of data.
64 bytes from 10.0.0.190: icmp_seq=1 ttl=63 time=2.22 ms

--- 10.0.0.190 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 2.224/2.224/2.224/0.000 ms




################################################################




(overcloud) [stack@undercloud-0 ~]$ nova migrate after_deploy
(overcloud) [stack@undercloud-0 ~]$ nova list
+--------------------------------------+--------------+--------+------------------+-------------+--------------------------------------+
| ID                                   | Name         | Status | Task State       | Power State | Networks                             |
+--------------------------------------+--------------+--------+------------------+-------------+--------------------------------------+
| b263728b-3bb2-477d-aac6-548eba6a9202 | after_deploy | RESIZE | resize_migrating | Running     | tenantvxlan=192.168.32.7, 10.0.0.190 |
+--------------------------------------+--------------+--------+------------------+-------------+--------------------------------------+

                                               |
(overcloud) [stack@undercloud-0 ~]$ nova list
+--------------------------------------+--------------+---------------+------------+-------------+--------------------------------------+
| ID                                   | Name         | Status        | Task State | Power State | Networks                             |
+--------------------------------------+--------------+---------------+------------+-------------+--------------------------------------+
| b263728b-3bb2-477d-aac6-548eba6a9202 | after_deploy | VERIFY_RESIZE | -          | Running     | tenantvxlan=192.168.32.7, 10.0.0.190 |
+--------------------------------------+--------------+---------------+------------+-------------+--------------------------------------+


(overcloud) [stack@undercloud-0 ~]$ nova resize-confirm after_deploy
(overcloud) [stack@undercloud-0 ~]$ nova list
+--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+
| ID                                   | Name         | Status | Task State | Power State | Networks                             |
+--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+
| b263728b-3bb2-477d-aac6-548eba6a9202 | after_deploy | ACTIVE | -          | Running     | tenantvxlan=192.168.32.7, 10.0.0.190 |
+--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+
(overcloud) [stack@undercloud-0 ~]$ nova show after_deploy|grep hyper
| OS-EXT-SRV-ATTR:hypervisor_hostname  | overcloud-compute-15.localdomain                                                 |
(overcloud) [stack@undercloud-0 ~]$ ping -c1 10.0.0.190
PING 10.0.0.190 (10.0.0.190) 56(84) bytes of data.
64 bytes from 10.0.0.190: icmp_seq=1 ttl=63 time=2.10 ms

--- 10.0.0.190 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 2.109/2.109/2.109/0.000 ms

Comment 12 errata-xmlrpc 2017-12-13 21:25:26 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2017:3462


Note You need to log in before you can comment on or make changes to this bug.