Bug 1917443 - instance create in tls-everywhere environment fails with "Cannot load certificate '/etc/pki/libvirt-vnc/server-cert.pem' & key '/etc/pki/libvirt-vnc/server-key.pem'"
Summary: instance create in tls-everywhere environment fails with "Cannot load certifi...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-tripleo-common
Version: 16.2 (Train)
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: beta
: 16.2 (Train on RHEL 8.4)
Assignee: Martin Schuppert
QA Contact: David Rosenfeld
URL:
Whiteboard:
: 1923160 (view as bug list)
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2021-01-18 13:54 UTC by Martin Schuppert
Modified: 2022-04-29 09:24 UTC (History)
6 users (show)

Fixed In Version: openstack-tripleo-common-11.4.1-2.20201223225910.6e95a99.el8ost
Doc Type: No Doc Update
Doc Text:
Clone Of:
Environment:
Last Closed: 2021-09-15 07:11:11 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
OpenStack gerrit 763721 0 None MERGED Change qemu user id to match previous releases 2021-02-11 22:33:05 UTC
Red Hat Issue Tracker OSP-3002 0 None None None 2022-04-29 09:24:25 UTC
Red Hat Product Errata RHEA-2021:3483 0 None None None 2021-09-15 07:11:33 UTC

Description Martin Schuppert 2021-01-18 13:54:20 UTC
Description of problem:

after deployment of tls-everywhere environment using OSP16.2 RHOS-16.2-RHEL-8-20210113.n.0 , instance create fails with:

2021-01-18 11:07:15.296 15 ERROR nova.scheduler.utils [req-65f44866-5c1f-4428-a6f0-f89e6d2e58b5 778f2a11ab0c47d6b03716d356267f85 4dbf111811364f8c8ccf119853ba5fc8 - default default] [instance: 095c397a-5bd7-423c-87ae-bdb98c55b60d] Error from last host: central-computehci0-0.redhat.local (node central-computehci0-0.redhat.local): ['Traceback (most recent call last):\n', '  File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 2435, in _build_and_run_instance\n    block_device_info=block_device_info)\n', '  File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 3684, in spawn\n    cleanup_instance_disks=created_disks)\n', '  File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 6525, in _create_domain_and_network\n    cleanup_instance_disks=cleanup_instance_disks)\n', '  File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 220, in __exit__\n    self.force_reraise()\n', '  File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 196, in force_reraise\n    six.reraise(self.type_, self.value, self.tb)\n', '  File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise\n    raise value\n', '  File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 6491, in _create_domain_and_network\n    post_xml_callback=post_xml_callback)\n', '  File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 6420, in _create_domain\n    guest.launch(pause=pause)\n', '  File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/guest.py", line 143, in launch\n    self._encoded_xml, errors=\'ignore\')\n', '  File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 220, in __exit__\n    self.force_reraise()\n', '  File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 196, in force_reraise\n    six.reraise(self.type_, self.value, self.tb)\n', '  File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise\n    raise value\n', '  File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/guest.py", line 138, in launch\n    return self._domain.createWithFlags(flags)\n', '  File "/usr/lib/python3.6/site-packages/eventlet/tpool.py", line 190, in doit\n    result = proxy_call(self._autowrap, f, *args, **kwargs)\n', '  File "/usr/lib/python3.6/site-packages/eventlet/tpool.py", line 148, in proxy_call\n    rv = execute(f, *args, **kwargs)\n', '  File "/usr/lib/python3.6/site-packages/eventlet/tpool.py", line 129, in execute\n    six.reraise(c, e, tb)\n', '  File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise\n    raise value\n', '  File "/usr/lib/python3.6/site-packages/eventlet/tpool.py", line 83, in tworker\n    rv = meth(*args, **kwargs)\n', '  File "/usr/lib64/python3.6/site-packages/libvirt.py", line 1265, in createWithFlags\n    if ret == -1: raise libvirtError (\'virDomainCreateWithFlags() failed\', dom=self)\n', "libvirt.libvirtError: internal error: process exited while connecting to monitor: 2021-01-18T11:07:12.489924Z qemu-kvm: -object tls-creds-x509,id=vnc-tls-creds0,dir=/etc/pki/libvirt-vnc,endpoint=server,verify-peer=yes: Cannot load certificate '/etc/pki/libvirt-vnc/server-cert.pem' & key '/etc/pki/libvirt-vnc/server-key.pem': Error while reading file.\n", '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', '  File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 2161, in _do_build_and_run_instance\n    filter_properties, request_spec)\n', '  File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 2535, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', "nova.exception.RescheduledException: Build of instance 095c397a-5bd7-423c-87ae-bdb98c55b60d was re-scheduled: internal error: process exited while connecting to monitor: 2021-01-18T11:07:12.489924Z qemu-kvm: -object tls-creds-x509,id=vnc-tls-creds0,dir=/etc/pki/libvirt-vnc,endpoint=server,verify-peer=yes: Cannot load certificate '/etc/pki/libvirt-vnc/server-cert.pem' & key '/etc/pki/libvirt-vnc/server-key.pem': Error while reading file.\n"]

Version-Release number of selected component (if applicable):
OSP 16.2 - RHOS-16.2-RHEL-8-20210113.n.0

How reproducible:


Steps to Reproduce:
1. deploy tls-e env
2. create instance
3.

Actual results:


Expected results:


Additional info:

Comment 1 Martin Schuppert 2021-01-18 13:57:06 UTC
With the change to TCIB container image create process the UID of the qemu user changed from
what was used before in OSP. This was fixed upstream mid of Dec with https://review.opendev.org/c/openstack/tripleo-common/+/763721 .
Container images and tripleo-common are synced once promotions happen upstream.

Comment 4 Yatin Karel 2021-02-03 14:17:50 UTC
*** Bug 1923160 has been marked as a duplicate of this bug. ***

Comment 9 errata-xmlrpc 2021-09-15 07:11:11 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat OpenStack Platform (RHOSP) 16.2 enhancement advisory), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2021:3483


Note You need to log in before you can comment on or make changes to this bug.