Description of problem: after deployment of tls-everywhere environment using OSP16.2 RHOS-16.2-RHEL-8-20210113.n.0 , instance create fails with: 2021-01-18 11:07:15.296 15 ERROR nova.scheduler.utils [req-65f44866-5c1f-4428-a6f0-f89e6d2e58b5 778f2a11ab0c47d6b03716d356267f85 4dbf111811364f8c8ccf119853ba5fc8 - default default] [instance: 095c397a-5bd7-423c-87ae-bdb98c55b60d] Error from last host: central-computehci0-0.redhat.local (node central-computehci0-0.redhat.local): ['Traceback (most recent call last):\n', ' File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 2435, in _build_and_run_instance\n block_device_info=block_device_info)\n', ' File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 3684, in spawn\n cleanup_instance_disks=created_disks)\n', ' File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 6525, in _create_domain_and_network\n cleanup_instance_disks=cleanup_instance_disks)\n', ' File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 220, in __exit__\n self.force_reraise()\n', ' File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 196, in force_reraise\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise\n raise value\n', ' File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 6491, in _create_domain_and_network\n post_xml_callback=post_xml_callback)\n', ' File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 6420, in _create_domain\n guest.launch(pause=pause)\n', ' File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/guest.py", line 143, in launch\n self._encoded_xml, errors=\'ignore\')\n', ' File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 220, in __exit__\n self.force_reraise()\n', ' File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 196, in force_reraise\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise\n raise value\n', ' File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/guest.py", line 138, in launch\n return self._domain.createWithFlags(flags)\n', ' File "/usr/lib/python3.6/site-packages/eventlet/tpool.py", line 190, in doit\n result = proxy_call(self._autowrap, f, *args, **kwargs)\n', ' File "/usr/lib/python3.6/site-packages/eventlet/tpool.py", line 148, in proxy_call\n rv = execute(f, *args, **kwargs)\n', ' File "/usr/lib/python3.6/site-packages/eventlet/tpool.py", line 129, in execute\n six.reraise(c, e, tb)\n', ' File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise\n raise value\n', ' File "/usr/lib/python3.6/site-packages/eventlet/tpool.py", line 83, in tworker\n rv = meth(*args, **kwargs)\n', ' File "/usr/lib64/python3.6/site-packages/libvirt.py", line 1265, in createWithFlags\n if ret == -1: raise libvirtError (\'virDomainCreateWithFlags() failed\', dom=self)\n', "libvirt.libvirtError: internal error: process exited while connecting to monitor: 2021-01-18T11:07:12.489924Z qemu-kvm: -object tls-creds-x509,id=vnc-tls-creds0,dir=/etc/pki/libvirt-vnc,endpoint=server,verify-peer=yes: Cannot load certificate '/etc/pki/libvirt-vnc/server-cert.pem' & key '/etc/pki/libvirt-vnc/server-key.pem': Error while reading file.\n", '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', ' File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 2161, in _do_build_and_run_instance\n filter_properties, request_spec)\n', ' File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 2535, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', "nova.exception.RescheduledException: Build of instance 095c397a-5bd7-423c-87ae-bdb98c55b60d was re-scheduled: internal error: process exited while connecting to monitor: 2021-01-18T11:07:12.489924Z qemu-kvm: -object tls-creds-x509,id=vnc-tls-creds0,dir=/etc/pki/libvirt-vnc,endpoint=server,verify-peer=yes: Cannot load certificate '/etc/pki/libvirt-vnc/server-cert.pem' & key '/etc/pki/libvirt-vnc/server-key.pem': Error while reading file.\n"] Version-Release number of selected component (if applicable): OSP 16.2 - RHOS-16.2-RHEL-8-20210113.n.0 How reproducible: Steps to Reproduce: 1. deploy tls-e env 2. create instance 3. Actual results: Expected results: Additional info:
With the change to TCIB container image create process the UID of the qemu user changed from what was used before in OSP. This was fixed upstream mid of Dec with https://review.opendev.org/c/openstack/tripleo-common/+/763721 . Container images and tripleo-common are synced once promotions happen upstream.
*** Bug 1923160 has been marked as a duplicate of this bug. ***
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (Red Hat OpenStack Platform (RHOSP) 16.2 enhancement advisory), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHEA-2021:3483