Bug 1310140

Description of problem:
When nova-serialproxy is used, live migration fails due to serial port issues

Version-Release number of selected component (if applicable):
RHEL OSP 7 y2

python-nova-2015.1.2-13.el7ost.noarch
openstack-nova-console-2015.1.2-13.el7ost.noarch
openstack-nova-scheduler-2015.1.2-13.el7ost.noarch
openstack-nova-serialproxy-2015.1.2-13.el7ost.noarch
openstack-nova-cert-2015.1.2-13.el7ost.noarch
openstack-nova-novncproxy-2015.1.2-13.el7ost.noarch
openstack-nova-api-2015.1.2-13.el7ost.noarch
openstack-nova-compute-2015.1.2-13.el7ost.noarch
python-novaclient-2.23.0-2.el7ost.noarch
openstack-nova-common-2015.1.2-13.el7ost.noarch
openstack-nova-conductor-2015.1.2-13.el7ost.noarch
libvirt-1.2.17-13.el7_2.3.x86_64

How reproducible:
Can reproduce every time

Steps to Reproduce:
1. Deploy OSP director (7.2) deployment with serialproxy enabled (Serial proxy customization documented here: https://github.com/jonjozwiak/openstack/tree/master/director-examples/serialproxy)
   In my case I used Cinder backed by NFS.  The same issue will exist with any backend
2. Boot an instance backed by cinder volume
nova boot --flavor 2 --block-device source=image,id=<id of image>,dest=volume,size=10,shutdown=preserve,bootindex=0 \
  myInstanceFromVolume
3. Attempt to migrate instance 
nova list 
nova show myInstanceFromVolume | grep host
nova live-migration <Instance ID> 

Actual results:
Instance does not migrate 

Expected results:
Instance moved to another hypervisor

Additional info:
Below is the /var/log/messages file from the compute node showing an error failing to bind a socket.  There is a bug upstream that is identical to this problem: 
     https://bugs.launchpad.net/nova/+bug/1455252 

To validate the issue is serial console specific, I editing /etc/nova/nova.conf on the compute and controllers, commented out the serial_console settings, and restarted nova on compute and controllers.  After that, I recreated a new instance and validated it's standard console was working (nova console-log <instance name> -> validate it gets a response).  After that, I did nova live-migrate and the migration worked without problems.  

If I revert and walk through the process again, it will fail to migrate again.  

/var/log/messages error on the compute node:  

Feb 18 17:48:55 overcloud-compute-1 journal: internal error: process exited while connecting to monitor: 2016-02-18T22:48:54.829400Z qemu-kvm: -chardev socket,id=charserial0,host=192.168.20.23,port=10000,server,nowait: Failed to bind socket: Cannot assign requested address
Feb 18 17:48:55 overcloud-compute-1 nova-compute: Traceback (most recent call last):
Feb 18 17:48:55 overcloud-compute-1 nova-compute: File "/usr/lib/python2.7/site-packages/eventlet/hubs/hub.py", line 457, in fire_timers
Feb 18 17:48:55 overcloud-compute-1 nova-compute: timer()
Feb 18 17:48:55 overcloud-compute-1 nova-compute: File "/usr/lib/python2.7/site-packages/eventlet/hubs/timer.py", line 58, in __call__
Feb 18 17:48:55 overcloud-compute-1 nova-compute: cb(*args, **kw)
Feb 18 17:48:55 overcloud-compute-1 nova-compute: File "/usr/lib/python2.7/site-packages/eventlet/event.py", line 168, in _do_send
Feb 18 17:48:55 overcloud-compute-1 nova-compute: waiter.switch(result)
Feb 18 17:48:55 overcloud-compute-1 nova-compute: File "/usr/lib/python2.7/site-packages/eventlet/greenthread.py", line 214, in main
Feb 18 17:48:55 overcloud-compute-1 nova-compute: result = function(*args, **kwargs)
Feb 18 17:48:55 overcloud-compute-1 nova-compute: File "/usr/lib/python2.7/site-packages/nova/utils.py", line 997, in context_wrapper
Feb 18 17:48:55 overcloud-compute-1 nova-compute: return func(*args, **kwargs)
Feb 18 17:48:55 overcloud-compute-1 nova-compute: File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 5674, in _live_migration_operation
Feb 18 17:48:55 overcloud-compute-1 nova-compute: instance=instance)
Feb 18 17:48:55 overcloud-compute-1 nova-compute: File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 85, in __exit__
Feb 18 17:48:55 overcloud-compute-1 nova-compute: six.reraise(self.type_, self.value, self.tb)
Feb 18 17:48:55 overcloud-compute-1 nova-compute: File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 5643, in _live_migration_operation
Feb 18 17:48:55 overcloud-compute-1 nova-compute: CONF.libvirt.live_migration_bandwidth)
Feb 18 17:48:55 overcloud-compute-1 nova-compute: File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 183, in doit
Feb 18 17:48:55 overcloud-compute-1 nova-compute: result = proxy_call(self._autowrap, f, *args, **kwargs)
Feb 18 17:48:55 overcloud-compute-1 nova-compute: File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 141, in proxy_call
Feb 18 17:48:55 overcloud-compute-1 nova-compute: rv = execute(f, *args, **kwargs)
Feb 18 17:48:55 overcloud-compute-1 nova-compute: File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 122, in execute
Feb 18 17:48:55 overcloud-compute-1 nova-compute: six.reraise(c, e, tb)
Feb 18 17:48:55 overcloud-compute-1 nova-compute: File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 80, in tworker
Feb 18 17:48:55 overcloud-compute-1 nova-compute: rv = meth(*args, **kwargs)
Feb 18 17:48:55 overcloud-compute-1 nova-compute: File "/usr/lib64/python2.7/site-packages/libvirt.py", line 1825, in migrateToURI2
Feb 18 17:48:55 overcloud-compute-1 nova-compute: if ret == -1: raise libvirtError ('virDomainMigrateToURI2() failed', dom=self)
Feb 18 17:48:55 overcloud-compute-1 nova-compute: libvirtError: internal error: process exited while connecting to monitor: 2016-02-18T22:48:54.829400Z qemu-kvm: -chardev socket,id=charserial0,host=192.168.20.23,port=10000,server,nowait: Failed to bind socket: Cannot assign requested address