Bug 1923160

Summary: Nova fails to build instances as it cannot load PKI certificates
Product: Red Hat OpenStack Reporter: Elvira <egarciar>
Component: python-networking-ovnAssignee: RHOS Maint <rhos-maint>
Status: CLOSED DUPLICATE QA Contact: Eran Kuris <ekuris>
Severity: high Docs Contact:
Priority: unspecified    
Version: 16.2 (Train)CC: apevec, lhh, lmartins, majopela, scohen, twilson, ykarel
Target Milestone: ---Keywords: AutomationBlocker, Regression
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard: DFG:Networking Squad:OVN
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-02-03 14:17:51 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Elvira 2021-02-01 13:39:37 UTC 
Description of problem:
Error found in job DFG-network-networking-ovn-16.2_director-rhel-virthost-3cont_2comp_1ipa-ipv4-geneve-tls[0] at CI: Nova cannot build instances because it cannot load PKI certificates

[0] https://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/view/DFG/view/network/view/networking-ovn/job/DFG-network-networking-ovn-16.2_director-rhel-virthost-3cont_2comp_1ipa-ipv4-geneve-tls/19/


#Logs in /var/log/containers/nova/nova-conductor.log.1:

libvirt.libvirtError: internal error: qemu unexpectedly closed the monitor: 2021-01-21T12:27:41.941769Z qemu-kvm: -object tls-creds-x509,id=vnc-tls-creds0,dir=/etc/pki/libvirt-vnc,endpoint=server,verify-peer=yes: Cannot load certificate '/etc/pki/libvirt-vnc/server-cert.pem' & key '/etc/pki/libvirt-vnc/server-key.pem': Error while reading file.\n", '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', '  File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 2161, in _do_build_and_run_instance\n    filter_properties, request_spec)\n', '  File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 2535, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', "nova.exception.RescheduledException: Build of instance cfcf4506-0675-4295-9a8f-b5b6a2c870b6 was re-scheduled: internal error: qemu unexpectedly closed the monitor: 2021-01-21T12:27:41.941769Z qemu-kvm: -object tls-creds-x509,id=vnc-tls-creds0,dir=/etc/pki/libvirt-vnc,endpoint=server,verify-peer=yes: Cannot load certificate '/etc/pki/libvirt-vnc/server-cert.pem' & key '/etc/pki/libvirt-vnc/server-key.pem': Error while reading file.\n"]


Version-Release number of selected component (if applicable):


How reproducible:
100%

Steps to Reproduce:
1.
2.
3.

Actual results:

Expected results:


Additional info:
Comment 2 Yatin Karel 2021-02-03 14:17:51 UTC 
Looks duplicate of https://bugzilla.redhat.com/show_bug.cgi?id=1917443, the user id issue is fixed with tag: 16.2_20210129.1, and i see http://rhos-ci-logs.lab.eng.tlv2.redhat.com/logs/rcj/DFG-network-networking-ovn-16.2_director-rhel-virthost-3cont_2comp_1ipa-ipv4-geneve-tls/21 is running with the fix tag but seems that job is failing for different reason. I will mark it as duplicate of other.

*** This bug has been marked as a duplicate of bug 1917443 ***