Hide Forgot
In a non-containerized environment, live-migration and cold-migration of instances involves relatively complex configuration to enable a secure SSH transport from one compute node to another. Nova-compute (cold-migration) and libvirtd (live-migration) share this transport. The current solution does not work with current containerized solution for a number of reasons and has been temporarily disabled.
Live migration works after disabling selinux on compute (https://bugzilla.redhat.com/show_bug.cgi?id=1495599) +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+ | 91c1d51c-2304-44d7-b7fc-9bbb50ef93f0 | after_deploy | ACTIVE | - | Running | tenantvxlan=192.168.32.9, 10.0.0.193 | +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+ (overcloud) [stack@undercloud-0 ~]$ nova show after_deploy|grep hyper .0.0.193| OS-EXT-SRV-ATTR:hypervisor_hostname | overcloud-novacompute3-1.localdomain | (overcloud) [stack@undercloud-0 ~]$ ping -c1 10.0.0.193 PING 10.0.0.193 (10.0.0.193) 56(84) bytes of data. 64 bytes from 10.0.0.193: icmp_seq=1 ttl=63 time=4.89 ms --- 10.0.0.193 ping statistics --- 1 packets transmitted, 1 received, 0% packet loss, time 0ms rtt min/avg/max/mdev = 4.892/4.892/4.892/0.000 ms (overcloud) [stack@undercloud-0 ~]$ nova live-migration after_deploy nova list: +--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+ | 91c1d51c-2304-44d7-b7fc-9bbb50ef93f0 | after_deploy | MIGRATING | migrating | Running | tenantvxlan=192.168.32.9, 10.0.0.193 | +--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+ | (overcloud) [stack@undercloud-0 ~]$ nova list +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+ | 91c1d51c-2304-44d7-b7fc-9bbb50ef93f0 | after_deploy | ACTIVE | - | Running | tenantvxlan=192.168.32.9, 10.0.0.193 | +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+ (overcloud) [stack@undercloud-0 ~]$ nova show after_deploy|grep hyper | OS-EXT-SRV-ATTR:hypervisor_hostname | overcloud-novacompute1-1.localdomain | (undercloud) [stack@undercloud-0 ~]$ ssh heat-admin.24.6 "hostname; sudo virsh list" overcloud-novacompute1-1 Id Name State ---------------------------------------------------- 1 instance-00000002 running
Environment for comment #3: openstack-tripleo-heat-templates-7.0.3-0.20171019091938.el7ost.noarch openstack-nova-compute-16.0.2-0.20171019183942.cb3abbd.el7ost.noarch
Environment: openstack-tripleo-heat-templates-7.0.3-0.20171019091938.el7ost.noarch openstack-nova-compute-16.0.2-0.20171019183942.cb3abbd.el7ost.noarch (overcloud) [stack@undercloud-0 ~]$ nova list +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+ | 91c1d51c-2304-44d7-b7fc-9bbb50ef93f0 | after_deploy | ACTIVE | - | Running | tenantvxlan=192.168.32.9, 10.0.0.193 | +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+ (overcloud) [stack@undercloud-0 ~]$ nova show after_deploy 2>/dev/null|grep hypervisor | OS-EXT-SRV-ATTR:hypervisor_hostname | overcloud-novacompute1-1.localdomain (overcloud) [stack@undercloud-0 ~]$ nova stop after_deploy 2>/dev/null Request to stop server after_deploy has been accepted. (overcloud) [stack@undercloud-0 ~]$ nova list 2>/dev/null +--------------------------------------+--------------+---------+------------+-------------+--------------------------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+--------------+---------+------------+-------------+--------------------------------------+ | 91c1d51c-2304-44d7-b7fc-9bbb50ef93f0 | after_deploy | SHUTOFF | - | Shutdown | tenantvxlan=192.168.32.9, 10.0.0.193 | +--------------------------------------+--------------+---------+------------+-------------+--------------------------------------+ (overcloud) [stack@undercloud-0 ~]$ nova show after_deploy 2>/dev/null|grep hypervisor | OS-EXT-SRV-ATTR:hypervisor_hostname | overcloud-novacompute1-1.localdomain | ( (overcloud) [stack@undercloud-0 ~]$ nova migrate after_deploy (overcloud) [stack@undercloud-0 ~]$ nova show after_deploy 2>/dev/null|grep hypervisor | OS-EXT-SRV-ATTR:hypervisor_hostname | overcloud-novacompute3-0.localdomain | (overcloud) [stack@undercloud-0 ~]$ nova start after_deploy ERROR (CommandError): Unable to start the specified server(s). (overcloud) [stack@undercloud-0 ~]$ nova list 2>/dev/null +--------------------------------------+--------------+---------------+------------+-------------+--------------------------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+--------------+---------------+------------+-------------+--------------------------------------+ | 91c1d51c-2304-44d7-b7fc-9bbb50ef93f0 | after_deploy | VERIFY_RESIZE | - | Shutdown | tenantvxlan=192.168.32.9, 10.0.0.193 | +--------------------------------------+--------------+---------------+------------+-------------+--------------------------------------+ (overcloud) [stack@undercloud-0 ~]$ nova resize-confirm after_deploy (overcloud) [stack@undercloud-0 ~]$ nova list 2>/dev/null +--------------------------------------+--------------+---------+------------+-------------+--------------------------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+--------------+---------+------------+-------------+--------------------------------------+ | 91c1d51c-2304-44d7-b7fc-9bbb50ef93f0 | after_deploy | SHUTOFF | - | Shutdown | tenantvxlan=192.168.32.9, 10.0.0.193 | +--------------------------------------+--------------+---------+------------+-------------+--------------------------------------+ (overcloud) [stack@undercloud-0 ~]$ nova start after_deploy Request to start server after_deploy has been accepted. (overcloud) [stack@undercloud-0 ~]$ nova list 2>/dev/null +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+ | 91c1d51c-2304-44d7-b7fc-9bbb50ef93f0 | after_deploy | ACTIVE | - | Running | tenantvxlan=192.168.32.9, 10.0.0.193 | +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+ (overcloud) [stack@undercloud-0 ~]$ ping -c1 10.0.0.193 PING 10.0.0.193 (10.0.0.193) 56(84) bytes of data. 64 bytes from 10.0.0.193: icmp_seq=1 ttl=63 time=1.70 ms --- 10.0.0.193 ping statistics --- 1 packets transmitted, 1 received, 0% packet loss, time 0ms rtt min/avg/max/mdev = 1.705/1.705/1.705/0.000 ms
Verified Environment: openstack-tripleo-heat-templates-7.0.3-0.20171023134948.el7ost.noarch openstack-nova-compute-16.0.2-0.20171023105738.a2e4540.el7ost.noarch Checked live migration again and it worked: (undercloud) [stack@undercloud-0 ~]$ . keystonerc_master (overcloud) [stack@undercloud-0 ~]$ nova list nova +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+ | b263728b-3bb2-477d-aac6-548eba6a9202 | after_deploy | ACTIVE | - | Running | tenantvxlan=192.168.32.7, 10.0.0.190 | +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+ (overcloud) [stack@undercloud-0 ~]$ nova show after_deploy|grep hyper pinc| OS-EXT-SRV-ATTR:hypervisor_hostname | overcloud-compute-15.localdomain | (overcloud) [stack@undercloud-0 ~]$ ping -c1 10.0.0.190 PING 10.0.0.190 (10.0.0.190) 56(84) bytes of data. 64 bytes from 10.0.0.190: icmp_seq=1 ttl=63 time=5.39 ms --- 10.0.0.190 ping statistics --- 1 packets transmitted, 1 received, 0% packet loss, time 0ms rtt min/avg/max/mdev = 5.390/5.390/5.390/0.000 ms (overcloud) [stack@undercloud-0 ~]$ nova live-migration after_deploy (overcloud) [stack@undercloud-0 ~]$ nova list +--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+ | b263728b-3bb2-477d-aac6-548eba6a9202 | after_deploy | MIGRATING | migrating | Running | tenantvxlan=192.168.32.7, 10.0.0.190 | +--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+ (overcloud) [stack@undercloud-0 ~]$ nova list +--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+ | b263728b-3bb2-477d-aac6-548eba6a9202 | after_deploy | MIGRATING | migrating | Running | tenantvxlan=192.168.32.7, 10.0.0.190 | +--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+ (overcloud) [stack@undercloud-0 ~]$ nova list +--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+ | b263728b-3bb2-477d-aac6-548eba6a9202 | after_deploy | MIGRATING | migrating | Running | tenantvxlan=192.168.32.7, 10.0.0.190 | +--------------------------------------+--------------+-----------+------------+-------------+--------------------------------------+ (overcloud) [stack@undercloud-0 ~]$ nova list +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+ | b263728b-3bb2-477d-aac6-548eba6a9202 | after_deploy | ACTIVE | - | Running | tenantvxlan=192.168.32.7, 10.0.0.190 | +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+ (overcloud) [stack@undercloud-0 ~]$ nova show after_deploy|grep hyper | OS-EXT-SRV-ATTR:hypervisor_hostname | overcloud-compute-14.localdomain | (overcloud) [stack@undercloud-0 ~]$ ping -c1 10.0.0.190 PING 10.0.0.190 (10.0.0.190) 56(84) bytes of data. 64 bytes from 10.0.0.190: icmp_seq=1 ttl=63 time=2.22 ms --- 10.0.0.190 ping statistics --- 1 packets transmitted, 1 received, 0% packet loss, time 0ms rtt min/avg/max/mdev = 2.224/2.224/2.224/0.000 ms ################################################################ (overcloud) [stack@undercloud-0 ~]$ nova migrate after_deploy (overcloud) [stack@undercloud-0 ~]$ nova list +--------------------------------------+--------------+--------+------------------+-------------+--------------------------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+--------------+--------+------------------+-------------+--------------------------------------+ | b263728b-3bb2-477d-aac6-548eba6a9202 | after_deploy | RESIZE | resize_migrating | Running | tenantvxlan=192.168.32.7, 10.0.0.190 | +--------------------------------------+--------------+--------+------------------+-------------+--------------------------------------+ | (overcloud) [stack@undercloud-0 ~]$ nova list +--------------------------------------+--------------+---------------+------------+-------------+--------------------------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+--------------+---------------+------------+-------------+--------------------------------------+ | b263728b-3bb2-477d-aac6-548eba6a9202 | after_deploy | VERIFY_RESIZE | - | Running | tenantvxlan=192.168.32.7, 10.0.0.190 | +--------------------------------------+--------------+---------------+------------+-------------+--------------------------------------+ (overcloud) [stack@undercloud-0 ~]$ nova resize-confirm after_deploy (overcloud) [stack@undercloud-0 ~]$ nova list +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+ | b263728b-3bb2-477d-aac6-548eba6a9202 | after_deploy | ACTIVE | - | Running | tenantvxlan=192.168.32.7, 10.0.0.190 | +--------------------------------------+--------------+--------+------------+-------------+--------------------------------------+ (overcloud) [stack@undercloud-0 ~]$ nova show after_deploy|grep hyper | OS-EXT-SRV-ATTR:hypervisor_hostname | overcloud-compute-15.localdomain | (overcloud) [stack@undercloud-0 ~]$ ping -c1 10.0.0.190 PING 10.0.0.190 (10.0.0.190) 56(84) bytes of data. 64 bytes from 10.0.0.190: icmp_seq=1 ttl=63 time=2.10 ms --- 10.0.0.190 ping statistics --- 1 packets transmitted, 1 received, 0% packet loss, time 0ms rtt min/avg/max/mdev = 2.109/2.109/2.109/0.000 ms
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHEA-2017:3462