Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1877150

Summary: Installer reports no route to host when accessing the api.<cluster_name>.<basedomain> for IPI installation
Product: OpenShift Container Platform Reporter: Jatan Malde <jmalde>
Component: InstallerAssignee: Martin André <m.andre>
Installer sub component: OpenShift on OpenStack QA Contact: David Sanz <dsanzmor>
Status: CLOSED DUPLICATE Docs Contact:
Severity: medium    
Priority: unspecified CC: pprinett
Version: 4.5Keywords: UpcomingSprint
Target Milestone: ---   
Target Release: 4.7.0   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2020-09-11 09:30:13 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Jatan Malde 2020-09-08 23:06:36 UTC 
Description of problem:

Using the openshift-install 4.6 feature test for OpenShift on OpenStack installation. 

The installation reportes no route to host as mentioned in the following output. 

DEBUG module.bootstrap.openstack_compute_instance_v2.bootstrap: Still creating... [20s elapsed] 
DEBUG module.bootstrap.openstack_compute_instance_v2.bootstrap: Creation complete after 22s [id=ce19bdf0-4d80-4f0d-b6b4-486145ba2d2f] 
DEBUG module.bootstrap.openstack_networking_floatingip_v2.bootstrap_fip[0]: Creating... 
DEBUG module.bootstrap.openstack_networking_floatingip_v2.bootstrap_fip[0]: Creation complete after 6s [id=9b643138-8c34-4b52-a874-452aa6bbe4b5] 
DEBUG                                              
DEBUG Apply complete! Resources: 54 added, 0 changed, 0 destroyed. 
DEBUG OpenShift Installer 4.6.0-fc.4               
DEBUG Built from commit 878562e15ce6c31148b4cff758ea70e685e6b6e3 
INFO Waiting up to 20m0s for the Kubernetes API at https://api.bugtest.openstack.testing:6443... 
DEBUG Still waiting for the Kubernetes API: Get "https://api.bugtest.openstack.testing:6443/version?timeout=32s": dial tcp 10.0.0.121:6443: connect: no route to host 
DEBUG Still waiting for the Kubernetes API: Get "https://api.bugtest.openstack.testing:6443/version?timeout=32s": dial tcp 10.0.0.121:6443: connect: no route to host 

Checking the machines I do see them up and running but the above messages looks misleading. Checking more on the ports, I see the api port 'bugtest-qfktm-api-port' is not attached to the configured 
APIfloatingIP.

Take a look at the following output. 

(overcloud) [stack@undercloud-0 ~]$ openstack server list
+--------------------------------------+-------------------------+--------+-------------------------------------------------+---------------------+--------+
| ID                                   | Name                    | Status | Networks                                        | Image               | Flavor |
+--------------------------------------+-------------------------+--------+-------------------------------------------------+---------------------+--------+
| ce19bdf0-4d80-4f0d-b6b4-486145ba2d2f | bugtest-qfktm-bootstrap | ACTIVE | bugtest-qfktm-openshift=100.0.1.223, 10.0.0.103 | bugtest-qfktm-rhcos |        |
| 3373f41c-f8f4-4258-9c68-7ead22aef53f | bugtest-qfktm-master-2  | ACTIVE | bugtest-qfktm-openshift=100.0.0.42              | bugtest-qfktm-rhcos |        |
| 25fd273b-97fd-4eed-a7d4-73e94b07a52f | bugtest-qfktm-master-1  | ACTIVE | bugtest-qfktm-openshift=100.0.3.148             | bugtest-qfktm-rhcos |        |
| edbaa114-9fe5-4309-a915-d8537ecacf22 | bugtest-qfktm-master-0  | ACTIVE | bugtest-qfktm-openshift=100.0.1.71              | bugtest-qfktm-rhcos |        |
+--------------------------------------+-------------------------+--------+-------------------------------------------------+---------------------+--------+
(overcloud) [stack@undercloud-0 ~]$ openstack port list
+--------------------------------------+--------------------------------------------------------------+-------------------+-----------------------------------------------------------------------------+--------+
| ID                                   | Name                                                         | MAC Address       | Fixed IP Addresses                                                          | Status |
+--------------------------------------+--------------------------------------------------------------+-------------------+-----------------------------------------------------------------------------+--------+
| 05941644-2d80-440c-b6e4-aefcc15ade32 | bugtest-qfktm-ingress-port                                   | fa:16:3e:0f:89:83 | ip_address='100.0.0.7', subnet_id='43751e5e-c43c-4dfc-9e5d-ea505cda7656'    | DOWN   |
| 1c83271a-dac1-412a-b39f-34a7dbc04fd8 |                                                              | fa:16:3e:fc:be:f4 | ip_address='100.0.0.1', subnet_id='43751e5e-c43c-4dfc-9e5d-ea505cda7656'    | ACTIVE |
| 2c7b69fd-89e0-46c0-9e1f-2ba7667ddc1b | bugtest-qfktm-master-port-2                                  | fa:16:3e:44:e4:8f | ip_address='100.0.0.42', subnet_id='43751e5e-c43c-4dfc-9e5d-ea505cda7656'   | ACTIVE |
| 2d367d3f-203f-4e94-adab-57d3d22aa4be |                                                              | fa:16:3e:de:be:c4 | ip_address='100.0.0.10', subnet_id='43751e5e-c43c-4dfc-9e5d-ea505cda7656'   | DOWN   |
| 4012db32-0845-4abe-9d89-d99b84300853 |                                                              | fa:16:3e:54:a9:98 | ip_address='10.0.0.202', subnet_id='705d43b7-6dcd-48fb-b2c9-c0997d43e3d9'   | N/A    |
| 4906fa0a-347d-40cc-baee-b82b0458a640 |                                                              | fa:16:3e:73:70:f2 | ip_address='10.0.0.2', subnet_id='705d43b7-6dcd-48fb-b2c9-c0997d43e3d9'     | DOWN   |
| 4ed710d3-232a-4b5c-bd69-91c5c8a1c516 |                                                              | fa:16:3e:59:2c:6d | ip_address='10.0.0.72', subnet_id='705d43b7-6dcd-48fb-b2c9-c0997d43e3d9'    | N/A    |
| 5b1bd6cc-b333-4972-a089-02617a83bf18 | bugtest-qfktm-master-port-0                                  | fa:16:3e:76:98:a4 | ip_address='100.0.1.71', subnet_id='43751e5e-c43c-4dfc-9e5d-ea505cda7656'   | ACTIVE |
| 77783f72-940b-4692-9d0a-62fdc80f90bb | bugtest-qfktm-master-port-1                                  | fa:16:3e:b4:b8:f9 | ip_address='100.0.3.148', subnet_id='43751e5e-c43c-4dfc-9e5d-ea505cda7656'  | ACTIVE |
| 80ed6abb-eb32-4251-b919-31a1dfa2ef65 |                                                              | fa:16:3e:96:cc:ab | ip_address='10.0.0.31', subnet_id='705d43b7-6dcd-48fb-b2c9-c0997d43e3d9'    | ACTIVE |
| 881367ce-0de9-4611-a6c0-dbcb2e5707a0 | bugtest-qfktm-api-port                                       | fa:16:3e:fe:8b:51 | ip_address='100.0.0.5', subnet_id='43751e5e-c43c-4dfc-9e5d-ea505cda7656'    | DOWN   |
| 8ce5f9cc-a456-4e25-b94b-d87b98208d5d |                                                              | fa:16:3e:25:ed:48 | ip_address='10.0.0.121', subnet_id='705d43b7-6dcd-48fb-b2c9-c0997d43e3d9'   | N/A    |
| 9a98aadf-6a79-41ea-9b46-f91942f00ce6 |                                                              | fa:16:3e:40:f4:25 | ip_address='172.24.0.2', subnet_id='c266e9b1-df75-4729-9881-85363ba1f882'   | DOWN   |
| a822de68-c301-42e5-a97c-58196444b3c6 |                                                              | fa:16:3e:6d:6d:e7 | ip_address='10.0.0.207', subnet_id='705d43b7-6dcd-48fb-b2c9-c0997d43e3d9'   | N/A    |
| b0ceea04-4e4e-4b3b-82b9-92733ea75500 |                                                              | fa:16:3e:98:fb:98 | ip_address='10.0.0.217', subnet_id='705d43b7-6dcd-48fb-b2c9-c0997d43e3d9'   | N/A    |
| b420b68f-0cd0-44d6-8d27-e8754fde0565 |                                                              | fa:16:3e:55:ef:dd | ip_address='10.0.0.103', subnet_id='705d43b7-6dcd-48fb-b2c9-c0997d43e3d9'   | N/A    |
| b7b2638f-4139-4011-a7c7-ccf3c403c340 | octavia-health-manager-controller-0.redhat.local-listen-port | fa:16:3e:50:de:58 | ip_address='172.24.1.243', subnet_id='c266e9b1-df75-4729-9881-85363ba1f882' | ACTIVE |
| d3250f7a-cf07-4429-a60c-5cce0b89f71a | bugtest-qfktm-bootstrap-port                                 | fa:16:3e:6e:c3:db | ip_address='100.0.1.223', subnet_id='43751e5e-c43c-4dfc-9e5d-ea505cda7656'  | ACTIVE |
+--------------------------------------+--------------------------------------------------------------+-------------------+-----------------------------------------------------------------------------+--------+
(overcloud) [stack@undercloud-0 ~]$ openstack floating ip list
+--------------------------------------+---------------------+------------------+--------------------------------------+--------------------------------------+----------------------------------+
| ID                                   | Floating IP Address | Fixed IP Address | Port                                 | Floating Network                     | Project                          |
+--------------------------------------+---------------------+------------------+--------------------------------------+--------------------------------------+----------------------------------+
| 0b83c228-6939-49de-8678-6e38ee276c00 | 10.0.0.202          | None             | None                                 | 53f22d7a-2116-4c9a-9073-3914483dbc1e | 4bcd9b14c3e14ee2afd90965cbb108d6 |
| 27c82875-007b-4766-b6fb-021fae072eae | 10.0.0.207          | None             | None                                 | 53f22d7a-2116-4c9a-9073-3914483dbc1e | 4bcd9b14c3e14ee2afd90965cbb108d6 |
| 6a09e5a0-65d7-4f20-bc6b-9c3cb8c67b57 | 10.0.0.72           | None             | None                                 | 53f22d7a-2116-4c9a-9073-3914483dbc1e | 4bcd9b14c3e14ee2afd90965cbb108d6 |
| 97c68ad5-0cc7-4090-beff-50e34680a3f6 | 10.0.0.217          | None             | None                                 | 53f22d7a-2116-4c9a-9073-3914483dbc1e | 4bcd9b14c3e14ee2afd90965cbb108d6 |
| 9b643138-8c34-4b52-a874-452aa6bbe4b5 | 10.0.0.103          | 100.0.1.223      | d3250f7a-cf07-4429-a60c-5cce0b89f71a | 53f22d7a-2116-4c9a-9073-3914483dbc1e | 4bcd9b14c3e14ee2afd90965cbb108d6 |
| be5caaca-1c4d-4fb8-a0e7-488e024d7425 | 10.0.0.121          | None             | None                                 | 53f22d7a-2116-4c9a-9073-3914483dbc1e | 4bcd9b14c3e14ee2afd90965cbb108d6 |
+--------------------------------------+---------------------+------------------+--------------------------------------+--------------------------------------+----------------------------------+
(overcloud) [stack@undercloud-0 ~]$ 


In the above output 10.0.0.121 is my api lbfloating ip which is not seen attached to api port. Should this be expected behavior?

Will attach the .openshift_install.log file and also the .openshift_install_state.json.

Version-Release number of the following components:
rpm -q openshift-ansible
rpm -q ansible
ansible --version

How reproducible:

Steps to Reproduce:
1.
2.
3.

Actual results:
Please include the entire output from the last TASK line through the end of output if an error is generated

Expected results:

Additional info:
Please attach logs from ansible-playbook with the -vvv flag
Comment 2 Martin André 2020-09-11 09:30:13 UTC 
Hi, what you're seeing is indeed very likely a side-effect of https://bugzilla.redhat.com/show_bug.cgi?id=1876825. We need the API FIP to be set in the install-config.yaml in order to associate it with the port.
Marking this as a duplicate, please re-open if you still see the issue after https://bugzilla.redhat.com/show_bug.cgi?id=1876825 is VERIFIED.

*** This bug has been marked as a duplicate of bug 1876825 ***