Bug 1769879 - [IPI][OSP] Machine-api cannot create workers on osp envs installed with self-signed certs
Summary: [IPI][OSP] Machine-api cannot create workers on osp envs installed with self-...
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Installer
Version: 4.3.0
Hardware: Unspecified
OS: Unspecified
Target Milestone: ---
: 4.4.0
Assignee: egarcia
QA Contact: David Sanz
Depends On:
Blocks: 1735192 1788072
TreeView+ depends on / blocked
Reported: 2019-11-07 16:29 UTC by David Sanz
Modified: 2020-05-13 21:52 UTC (History)
19 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
: 1788072 (view as bug list)
Last Closed: 2020-05-13 21:52:26 UTC
Target Upstream Version:

Attachments (Terms of Use)

System ID Priority Status Summary Last Updated
Github openshift cluster-api-provider-openstack pull 78 None closed Bug 1769879: allow CA Cert bundles to be trusted 2020-10-26 15:03:06 UTC
Github openshift cluster-api-provider-openstack pull 79 None closed Bug 1769879: SSC refractor 2020-10-26 15:03:06 UTC
Github openshift enhancements pull 115 'None' closed enhancements/x509-trust: Propose a new enhancement 2020-10-26 15:03:06 UTC
Github openshift installer pull 2639 'None' closed Bug 1769879: add AdditionalTrustBundles to master and worker shims 2020-10-26 15:03:07 UTC
Github openshift installer pull 3009 None closed Bug 1769879: Docs: openstack self signed certs docs 2020-10-26 15:03:07 UTC
Github openshift installer pull 3040 None closed Bug 1769879: remove self signed certs from known issues 2020-10-26 15:03:07 UTC
Red Hat Knowledge Base (Solution) 4735631 None None None 2020-01-15 09:52:28 UTC
Red Hat Product Errata RHBA-2020:0581 None None None 2020-05-13 21:52:34 UTC

Internal Links: 1735192

Description David Sanz 2019-11-07 16:29:19 UTC
Description of problem:
Machine-api cannot create workers on OSP installation with Self-signed certs

Version-Release number of selected component (if applicable):

How reproducible:

Steps to Reproduce:
1.Run installation of OCP on Openstack
2.Watch workers creation
3.oc logs -f pod/machine-api-controllers-xxxx-xxxx -c machine-controller

I1107 16:25:33.656976       1 controller.go:164] Reconciling Machine "morenod-ocp-mhxnq-worker-xv7p4"
I1107 16:25:33.657036       1 controller.go:376] Machine "morenod-ocp-mhxnq-worker-xv7p4" in namespace "openshift-machine-api" doesn't specify "cluster.k8s.io/cluster-name" label, assuming nil cluster
E1107 16:25:33.664586       1 controller.go:279] Failed to check if machine "morenod-ocp-mhxnq-worker-xv7p4" exists: Error checking if instance exists (machine/actuator.go 346): 
Error getting a new instance service from the machine (machine/actuator.go 467): Create providerClient err: Post x509: certificate signed by unknown authority

Actual results:
Workers are not created

Expected results:
Workers are created

Additional info:

Comment 2 egarcia 2019-11-20 18:42:07 UTC
A proposed solution to CA bundle distribution within OpenShift clusters is being discussed here: https://github.com/openshift/enhancements/pull/115. Development cannot move forwards until this feature is implemented.

Comment 10 David Sanz 2020-01-31 16:42:40 UTC
Verified on 4.4.0-0.nightly-2020-01-31-144949

Workers are correctly created both by the installer and scaling using the machinest

NAME                             STATUS   ROLES    AGE   VERSION
morenod-ssl-htrmd-master-0	 Ready    master   43m   v1.17.1
morenod-ssl-htrmd-master-1	 Ready    master   43m   v1.17.1
morenod-ssl-htrmd-master-2	 Ready    master   43m   v1.17.1
morenod-ssl-htrmd-worker-hqxx5   Ready    worker   21m   v1.17.1
morenod-ssl-htrmd-worker-kckq2   Ready    worker   22m   v1.17.1
NAME                             PHASE     TYPE        REGION   ZONE   AGE
morenod-ssl-htrmd-master-0       Running   m4.xlarge            nova   45m
morenod-ssl-htrmd-master-1       Running   m4.xlarge            nova   45m
morenod-ssl-htrmd-master-2	 Running   m4.xlarge            nova   45m
morenod-ssl-htrmd-worker-hqxx5   Running   m4.xlarge            nova   38m
morenod-ssl-htrmd-worker-kckq2   Running   m4.xlarge            nova   38m
NAME                       DESIRED   CURRENT   READY   AVAILABLE   AGE
morenod-ssl-htrmd-worker   2         2         2       2           45m

[stack@undercloud-0 morenod]$ openstack server list
| ID                                   | Name                           | Status | Networks                                | Image                   | Flavor    |
| 5c979035-d762-4120-ba1e-ecb2c4ec6435 | morenod-ssl-htrmd-worker-tzgzn | ACTIVE | morenod-ssl-htrmd-openshift= | morenod-ssl-htrmd-rhcos | m4.xlarge |
| 3b2fb4d5-5401-4025-9fbb-2e1640a5d4d2 | morenod-ssl-htrmd-worker-2kgbm | ACTIVE | morenod-ssl-htrmd-openshift= | morenod-ssl-htrmd-rhcos | m4.xlarge |
| e47e3de6-b2b1-4833-90fc-60f69011ac2d | morenod-ssl-htrmd-worker-kckq2 | ACTIVE | morenod-ssl-htrmd-openshift= | morenod-ssl-htrmd-rhcos | m4.xlarge |
| c21436b6-fdf5-4305-b5a5-ae8040140123 | morenod-ssl-htrmd-worker-hqxx5 | ACTIVE | morenod-ssl-htrmd-openshift= | morenod-ssl-htrmd-rhcos | m4.xlarge |
| 5003b464-f8ce-42d3-8198-fc78e0c5d08f | morenod-ssl-htrmd-master-0     | ACTIVE | morenod-ssl-htrmd-openshift= | morenod-ssl-htrmd-rhcos | m4.xlarge |
| e8f364f4-0464-41bc-8b10-3609f5066654 | morenod-ssl-htrmd-master-2     | ACTIVE | morenod-ssl-htrmd-openshift= | morenod-ssl-htrmd-rhcos | m4.xlarge |
| b5313ee0-bbce-4772-986a-56250af47bcd | morenod-ssl-htrmd-master-1     | ACTIVE | morenod-ssl-htrmd-openshift= | morenod-ssl-htrmd-rhcos | m4.xlarge |

NAME                             STATUS   ROLES    AGE     VERSION
morenod-ssl-htrmd-master-0	 Ready    master   51m     v1.17.1
morenod-ssl-htrmd-master-1	 Ready    master   52m     v1.17.1
morenod-ssl-htrmd-master-2	 Ready    master   51m     v1.17.1
morenod-ssl-htrmd-worker-2kgbm   Ready    worker   3m47s   v1.17.1
morenod-ssl-htrmd-worker-hqxx5   Ready    worker   30m     v1.17.1
morenod-ssl-htrmd-worker-kckq2   Ready    worker   30m     v1.17.1
morenod-ssl-htrmd-worker-tzgzn   Ready    worker   2m47s   v1.17.1
NAME                             PHASE     TYPE        REGION   ZONE   AGE
morenod-ssl-htrmd-master-0	 Running   m4.xlarge            nova   53m
morenod-ssl-htrmd-master-1	 Running   m4.xlarge            nova   53m
morenod-ssl-htrmd-master-2	 Running   m4.xlarge            nova   53m
morenod-ssl-htrmd-worker-2kgbm   Running   m4.xlarge            nova   8m2s
morenod-ssl-htrmd-worker-hqxx5   Running   m4.xlarge            nova   46m
morenod-ssl-htrmd-worker-kckq2   Running   m4.xlarge            nova   46m
morenod-ssl-htrmd-worker-tzgzn   Running   m4.xlarge            nova   8m2s
NAME                       DESIRED   CURRENT   READY   AVAILABLE   AGE
morenod-ssl-htrmd-worker   4         4         4       4           53m

Comment 11 Scott Dodson 2020-02-03 18:19:37 UTC
All changes are in and should be moved to ON_QA

Comment 15 errata-xmlrpc 2020-05-13 21:52:26 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.


Note You need to log in before you can comment on or make changes to this bug.