Bug 1883166
| Summary: | Ports that belong to deleted nodes are leftover | ||
|---|---|---|---|
| Product: | OpenShift Container Platform | Reporter: | Luis Tomas Bolivar <ltomasbo> |
| Component: | Networking | Assignee: | Luis Tomas Bolivar <ltomasbo> |
| Networking sub component: | kuryr | QA Contact: | GenadiC <gcheresh> |
| Status: | CLOSED ERRATA | Docs Contact: | |
| Severity: | urgent | ||
| Priority: | medium | CC: | rlobillo |
| Version: | 4.6 | Keywords: | TestBlockerForLayeredProduct |
| Target Milestone: | --- | ||
| Target Release: | 4.6.0 | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | If docs needed, set a value | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2020-10-27 16:45:44 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
| Bug Depends On: | |||
| Bug Blocks: | 1883419, 1883565, 1883825, 1883832 | ||
|
Description
Luis Tomas Bolivar
2020-09-28 09:12:54 UTC
Failed on OCP4.6.0-0.nightly-2020-09-30-052433.
The installation is not completed because the cleanup_removed_nodes task on kuryr-controller is removing the API and the ingress ports.
The condition to identify the ports that need to be removed is below:
$ openstack port list --device-owner="" --tags="openshiftClusterID=ostest-6lmxj" --long
+--------------------------------------+---------------------------+-------------------+---------------------------------------------------------------------------+--------+-----------------
---------------------+--------------+---------------------------------+
| ID | Name | MAC Address | Fixed IP Addresses | Status | Security Groups
| Device Owner | Tags |
+--------------------------------------+---------------------------+-------------------+---------------------------------------------------------------------------+--------+-----------------
---------------------+--------------+---------------------------------+
| 5bb2ed13-736c-47a9-b748-bc2e6ac0239e | ostest-6lmxj-api-port | fa:16:3e:a2:14:14 | ip_address='10.196.0.5', subnet_id='dad606a9-40a8-4073-930a-be719cf1dae1' | DOWN | 52af0920-4121-4e
1c-b8a7-31677d63eacb | | openshiftClusterID=ostest-6lmxj |
| d148eb97-bb7d-4f3e-9ad5-c7a2a05d36d3 | ostest-6lmxj-ingress-port | fa:16:3e:be:50:1d | ip_address='10.196.0.7', subnet_id='dad606a9-40a8-4073-930a-be719cf1dae1' | DOWN | 9078438b-688c-40
3d-b056-0c38af913017 | | openshiftClusterID=ostest-6lmxj |
+--------------------------------------+---------------------------+-------------------+---------------------------------------------------------------------------+--------+-----------------
---------------------+--------------+---------------------------------+
leading to their incorrect removal.
Verified on OCP 4.6.0-0.nightly-2020-10-02-001427 on RHOS-16.1-RHEL-8-20200917.n.3 with OVN-Octavia. On a given installation with 3 workers, these are the details for the three trunk ports: $ openstack network trunk list +--------------------------------------+-----------------------------+--------------------------------------+-------------+ | ID | Name | Parent Port | Description | +--------------------------------------+-----------------------------+--------------------------------------+-------------+ | 311b4170-780a-49d3-9c5f-09a599c0b036 | ostest-7vhfl-worker-0-smgph | 5085a665-75d4-441d-9f2f-6fe3c8c2618a | | | 5b7b9b98-d0c2-4141-b1a7-59b2c3445171 | ostest-7vhfl-worker-0-f2qjj | eaec69c3-26e4-41a4-b6dc-1b6912019cf5 | | | 9b5807a0-d461-4292-97cb-a67fe612074d | ostest-7vhfl-master-trunk-2 | 01ad57e8-6af3-495b-a063-4f1bef126ef9 | | | b00e2fd6-5663-4b29-a75b-733ff4afb705 | ostest-7vhfl-worker-0-4qwmt | ae821759-86f9-4de9-9688-5a91177397f2 | | | b3fc0cfa-af63-485a-8d9b-4eec2cb411d8 | ostest-7vhfl-master-trunk-1 | 8a482f55-f895-4e5e-acde-d208ed2de511 | | | b6fc141a-6310-4137-b151-19ee03c7e514 | ostest-7vhfl-master-trunk-0 | f4b95048-fb04-4664-a70d-71c169ac01a5 | | +--------------------------------------+-----------------------------+--------------------------------------+-------------+ # ostest-7vhfl-worker-0-smgph $ openstack network subport list --trunk 311b4170-780a-49d3-9c5f-09a599c0b036 +--------------------------------------+-------------------+-----------------+ | Port | Segmentation Type | Segmentation ID | +--------------------------------------+-------------------+-----------------+ | bcf246f3-ac61-47a7-b56f-5955489cf57d | vlan | 91 | | 7c6cb2b1-4f64-43e5-99d4-c6ee34419acf | vlan | 147 | | e862bd43-b547-40c1-b5ae-9fd35767d0c5 | vlan | 299 | | b8493a02-e127-4740-a23e-8e7547978a1f | vlan | 391 | | 1c8283cd-464c-41ca-880e-de9ebe4d8bd0 | vlan | 449 | | cf7ec16e-91a1-42f8-bfc9-f921a33aa772 | vlan | 751 | | 294ffb94-1a68-47b2-96d8-6d4ff7c4d64b | vlan | 821 | | 3475ac48-80de-4830-8bb1-1a28016c7a76 | vlan | 877 | | 0fe77f36-dbe9-43b2-81b2-672a1be32481 | vlan | 1010 | | 44af1ff5-dbd8-4990-85d6-82054846ed60 | vlan | 1049 | | 5896ba5c-9287-4429-a517-a21447280eb6 | vlan | 1085 | | 03822dad-ef3f-448d-9037-cb5c6021adde | vlan | 1299 | | 7a650a42-226a-4ed6-97f2-b5932a92c5a4 | vlan | 1703 | | 8b755e24-44de-41d1-9a33-c136de805914 | vlan | 1726 | | f36ae904-a533-4898-8b6a-ab65b067f0c9 | vlan | 1738 | | 822e304d-0e61-4ca1-81c6-b07308a9ec60 | vlan | 1850 | | 38b20269-a381-4509-97d4-6f844ee7a9a7 | vlan | 1914 | | 86476c39-da28-48a0-ac18-8df236e24ed2 | vlan | 2306 | | 3bc935a8-466b-4f06-bf7b-7400ba0bde25 | vlan | 2420 | | 1f4df47c-b8dc-4814-8902-9bc18a8f956a | vlan | 2429 | | 548ef0f6-1a86-44cb-8118-eb70319a7561 | vlan | 2677 | | b7a32887-f382-4760-9329-7cdc45c86804 | vlan | 2952 | | d6788a59-3c7b-4a57-b536-0be818989152 | vlan | 3059 | | 1b918412-d9e7-4d9c-af13-200241b71204 | vlan | 3073 | | 13b3a67d-7118-46e9-9ddb-7e1eca81e8d7 | vlan | 3299 | | 460fd895-c662-42a0-a63f-0190aee1fc8d | vlan | 3306 | | 4774de1c-70ba-4b86-bd31-dce2446622c8 | vlan | 3335 | | f3593665-2b21-475c-80b2-564cf77a093a | vlan | 3860 | | a8c5652a-b803-4ae6-819d-796d857127bd | vlan | 3915 | | fe72c2ab-ff15-4264-ae1c-15203c856f3e | vlan | 3993 | +--------------------------------------+-------------------+-----------------+ # ostest-7vhfl-worker-0-f2qjj $ openstack network subport list --trunk 5b7b9b98-d0c2-4141-b1a7-59b2c3445171 +--------------------------------------+-------------------+-----------------+ | Port | Segmentation Type | Segmentation ID | +--------------------------------------+-------------------+-----------------+ | 99baf6f0-7dff-4e9e-8010-7670d0bca56e | vlan | 19 | | 6f8a1f76-f1fd-4d7a-9e72-182aad049523 | vlan | 60 | | 23448c13-bef7-4140-8a87-f8ed3562a6c5 | vlan | 117 | | 2781570a-38ed-418f-a269-4160e49387d8 | vlan | 168 | | 3e698c67-90f9-42ef-9f8a-f7614a24c4fb | vlan | 170 | | 55b15bcb-a03a-4e51-a678-b7698e101bbb | vlan | 376 | | 07f91eb2-f613-419f-a793-c477432c8f23 | vlan | 416 | | 38e954c7-8199-4ad9-883a-a11abd56699d | vlan | 461 | | a2166b53-1f87-4ee9-a019-9009ae33d012 | vlan | 540 | | 0b3c04ff-c7e3-4326-b5f7-87fe81326614 | vlan | 585 | | bf4e56d0-f52e-4f5a-ad13-636cb685f18f | vlan | 609 | | 257a9696-a638-4fe1-b3fb-31f84632b8d6 | vlan | 610 | | 202e8cff-31c0-47dc-8dd7-9b21c5850161 | vlan | 617 | | 3e194c78-3515-4847-b9dd-a99037c75a0a | vlan | 619 | | 4b1ed9d9-05f2-4290-ac47-34d8dd8903b0 | vlan | 636 | | 177d1c8d-e33d-4103-9726-90f8db7e7780 | vlan | 803 | | 8880b8a6-f0ca-4de3-9325-66b6ed1e792c | vlan | 1117 | | 810522a0-3aea-4252-a810-d7f6b5a008f8 | vlan | 1219 | | 736c5741-ae2c-4aab-a362-2a74ef6a44ec | vlan | 1363 | | 8be49b97-10c7-4125-ae02-f18e00f742f1 | vlan | 1396 | | 4f974dea-2c6e-4968-87ed-3d11c75b67cd | vlan | 1429 | | 93ffc525-e84b-4604-8228-2dc5158f7c97 | vlan | 1573 | | 10e434f0-ecf6-4d5d-9c1e-741acc53f931 | vlan | 1677 | | dc753230-ccf8-4f3e-91d5-05102656cf2a | vlan | 1756 | | e233c7aa-613b-4b62-8c4b-42f2d5c9c35f | vlan | 1788 | | bf4957d5-3ce1-46e1-ba0d-f79eae622669 | vlan | 1805 | | 9219f45b-19a7-445f-a125-2003817e2aab | vlan | 1862 | | 93c43bc9-b56d-4d14-bd40-1d22c14225ab | vlan | 1926 | | 950a53a4-1375-4c4f-b961-eb81f078b6bd | vlan | 2017 | | 0453f8d4-555c-48cd-b0c9-289f518a7ff7 | vlan | 2026 | | 6b33e86c-3a43-4495-af5b-1b54cfc8be4d | vlan | 2058 | | 4eb6d580-0d97-4ae7-80ed-5dd99f20e6e6 | vlan | 2087 | | 477a9039-4651-4a7d-8851-dabd3824e15a | vlan | 2093 | | 4415f504-f69d-46f6-9bf7-822deffd4e60 | vlan | 2199 | | 30749d75-b584-41e8-a964-4c16d2b6d65c | vlan | 2446 | | 24c7ae31-bd17-4074-9091-953246f9cfd0 | vlan | 2662 | | df75ec21-81b4-46e2-a583-2c3124e48132 | vlan | 2691 | | 14e66a89-b568-4790-ad4a-194676f247ee | vlan | 2703 | | 81b93e99-c948-4545-a714-6cd7f1c30be4 | vlan | 2791 | | eea1bdd7-e92c-433f-8c71-1e8f41847ef3 | vlan | 2953 | | 92cdb128-7112-467d-b760-49efb4f33126 | vlan | 3055 | | bfd1b5ef-f0b9-4f25-8ca4-2ef9f2b5fa08 | vlan | 3078 | | 8a2c855b-388d-4c76-b259-6155e7b22a3b | vlan | 3086 | | 85975053-5f46-4313-b828-998764238b80 | vlan | 3469 | | bc5e2305-7a13-40ee-b104-196bf2992ae1 | vlan | 3578 | | 2f732fe9-11d3-44ec-9c64-02042884cf5c | vlan | 3719 | | fa82ab20-6382-40d5-9a43-0655752aa793 | vlan | 3785 | | 91c13e71-feaa-4d19-b119-48d936848cca | vlan | 3835 | | d2539b89-efa7-44ff-8171-aafa9a807bc5 | vlan | 3852 | | bb80dd91-18bf-4512-847a-6eb5202e9ddf | vlan | 3863 | | 45b3609c-cb3b-45e7-afb2-00757411cb23 | vlan | 3911 | | 4ec78486-8da5-4e75-8a8f-0192e444293c | vlan | 3961 | | 9468a7cb-2e7e-435c-91d8-46741ad9de2f | vlan | 3994 | | ba5842be-0af3-471f-9556-0a1235e4b40b | vlan | 4006 | +--------------------------------------+-------------------+-----------------+ # ostest-7vhfl-worker-0-4qwmt $ openstack network subport list --trunk b00e2fd6-5663-4b29-a75b-733ff4afb705 +--------------------------------------+-------------------+-----------------+ | Port | Segmentation Type | Segmentation ID | +--------------------------------------+-------------------+-----------------+ | 072fc83d-1678-41f2-a01d-a4a8fa3723e5 | vlan | 67 | | 2093c059-ad92-42c4-ac31-ea1493859aaf | vlan | 102 | | 7c3edbe5-d431-45ff-8dc4-ccde3af24096 | vlan | 155 | | 9c5c4180-476a-4d38-81a3-a9a7e1cb849a | vlan | 263 | | dfa01a44-c033-48eb-894e-66d84d1ffd9d | vlan | 317 | | dffe890e-0a23-4ab9-8be8-511f6c5b142d | vlan | 355 | | 031ecd1c-baf8-4af8-81dd-0f6154fc82ac | vlan | 471 | | 2813434a-7f7e-4035-96ee-4516ac20be0e | vlan | 653 | | 19cbfb95-6c5a-4057-ae89-6a04e6dd8a1b | vlan | 757 | | dfd357d6-fc27-4576-89bd-5378d3aec03d | vlan | 807 | | 7498cc9f-0200-4665-a83f-964005663dca | vlan | 1183 | | 389144e3-7f03-4769-90f2-3f8b17af177a | vlan | 1231 | | 56f75706-411f-4007-8323-8c16516770b2 | vlan | 1287 | | 4f703c8e-4de2-4612-8268-3a31edd89ef7 | vlan | 1486 | | 09a90c4c-5185-4447-a40e-2a8be1c07728 | vlan | 1500 | | 622ca174-7f81-4c9d-b9a7-6fb72a1a6ea4 | vlan | 1908 | | caa33d6f-ce88-4c68-a773-f96fd49adf92 | vlan | 2084 | | 0335bf7f-646c-4922-b06b-55701aa31aaf | vlan | 2088 | | 572a8dd9-eba8-4b23-99a0-db236b83f01c | vlan | 2106 | | fe0669bf-3837-4af1-96a8-3cfac978ee3f | vlan | 2127 | | 02c39628-bdc0-4449-9c32-ab5d38bb8994 | vlan | 2243 | | 9222ef15-f027-477d-87a8-3cf61abf7974 | vlan | 2262 | | b6dda3e9-f0d5-4c5d-8ae1-13ea52e73275 | vlan | 2269 | | 18b2afcb-da90-402c-9438-6c00368a01d1 | vlan | 2352 | | 766e04d1-9802-48c2-81a1-b832253956a0 | vlan | 2523 | | fd50b8d0-5798-4bdf-b807-2d2cfb4cda89 | vlan | 2525 | | 25b17da4-ce8f-40a8-b863-198cffef867f | vlan | 2825 | | d16f2a2e-418a-4fd8-b5c2-a18dae21cdda | vlan | 2851 | | 74e6a8ef-85ba-4acf-b0a8-80a493b80b4e | vlan | 2966 | | 93c8c332-817b-43f6-b408-fb42f292887e | vlan | 2993 | | c190872a-e9ea-4ac6-9337-d231718249b7 | vlan | 3133 | | 28145a66-a675-4320-9595-0e79a59da0d8 | vlan | 3202 | | 454132d2-ae95-4835-a7ad-d39fd0bfe656 | vlan | 3463 | | 593ea2a2-c350-4c05-81eb-e797440d4f74 | vlan | 3479 | | 41952b0c-bc39-4b89-9069-c1b6e2ff5871 | vlan | 3629 | | 2042113b-1844-4f2b-b434-b27912adf60b | vlan | 3786 | | fa5c5d6b-1f78-4cca-9d48-60e3bb5588f6 | vlan | 3794 | | 4ffb8c04-c320-4ecb-b439-08f849dc1932 | vlan | 3903 | | 31dfdcdf-8cdf-43ff-98ea-0ce928bc7f29 | vlan | 4092 | +--------------------------------------+-------------------+-----------------+ Now, reducing the number of replicas in the machineset will remove the trunk and a job running periodically (every 60 seconds) on kuryr-controller will remove the subports. Before removing the worker, we have: $ openstack port list --device-owner="" --tags="openshiftClusterID=ostest-7vhfl" --long +--------------------------------------+---------------------------+-------------------+---------------------------------------------------------------------------+--------+--------------------------------------+--------------+---------------------------------+ | ID | Name | MAC Address | Fixed IP Addresses | Status | Security Groups | Device Owner | Tags | +--------------------------------------+---------------------------+-------------------+---------------------------------------------------------------------------+--------+--------------------------------------+--------------+---------------------------------+ | 44cad2ec-fc43-47c6-914e-feb62f5e7137 | ostest-7vhfl-ingress-port | fa:16:3e:3e:d4:da | ip_address='10.196.0.7', subnet_id='4939e931-9854-4352-a259-dbf556adfb07' | DOWN | aa716c98-31a6-431a-a252-4da6c591454f | | openshiftClusterID=ostest-7vhfl | | 8e107d1c-4903-45db-90c3-5ec995998909 | ostest-7vhfl-api-port | fa:16:3e:93:3f:27 | ip_address='10.196.0.5', subnet_id='4939e931-9854-4352-a259-dbf556adfb07' | DOWN | dcec4516-f80e-4e3a-8216-879bb7e1f401 | | openshiftClusterID=ostest-7vhfl | +--------------------------------------+---------------------------+-------------------+---------------------------------------------------------------------------+--------+--------------------------------------+--------------+---------------------------------+ Reducing replica to 2, ostest-7vhfl-worker-0-4qwmt is scheduled to be deleted: $ oc edit machineset -n openshift-machine-api ostest-7vhfl-worker-0 $ oc get nodes ; openstack port list --device-owner="" --tags="openshiftClusterID=ostest-7vhfl" NAME STATUS ROLES AGE VERSION ostest-7vhfl-master-0 Ready master 3h20m v1.19.0+beb741b ostest-7vhfl-master-1 Ready master 3h20m v1.19.0+beb741b ostest-7vhfl-master-2 Ready master 3h20m v1.19.0+beb741b ostest-7vhfl-worker-0-4qwmt Ready,SchedulingDisabled worker 171m v1.19.0+beb741b ostest-7vhfl-worker-0-f2qjj Ready worker 171m v1.19.0+beb741b ostest-7vhfl-worker-0-smgph Ready worker 171m v1.19.0+beb741b # Ports from the trunk are detached waiting to be deleted by the periodic task: $ openstack port list --device-owner="" --tags="openshiftClusterID=ostest-7vhfl" +--------------------------------------+-----------------------------+-------------------+-------------------------------------------------------------------------------+--------+ | ID | Name | MAC Address | Fixed IP Addresses | Status | [0/1956] +--------------------------------------+-----------------------------+-------------------+-------------------------------------------------------------------------------+--------+ | 02c39628-bdc0-4449-9c32-ab5d38bb8994 | | fa:16:3e:8f:ff:e7 | ip_address='10.128.30.3', subnet_id='91cbb3bd-774a-430a-b68b-604ee259c118' | DOWN | | 031ecd1c-baf8-4af8-81dd-0f6154fc82ac | | fa:16:3e:45:05:a0 | ip_address='10.128.102.49', subnet_id='42181d8d-fec9-4a96-85b4-fdaaaf015b32' | DOWN | | 0335bf7f-646c-4922-b06b-55701aa31aaf | | fa:16:3e:0d:8f:95 | ip_address='10.128.24.116', subnet_id='32cf6760-056c-49a2-b675-db4d72c8de76' | DOWN | | 072fc83d-1678-41f2-a01d-a4a8fa3723e5 | | fa:16:3e:10:83:98 | ip_address='10.128.8.5', subnet_id='c04ac33f-0560-4a8a-9f32-9461331500eb' | DOWN | | 09a90c4c-5185-4447-a40e-2a8be1c07728 | | fa:16:3e:f0:16:ab | ip_address='10.128.47.193', subnet_id='86a70bc2-c45a-4ced-8130-19fbb9fabf64' | DOWN | | 19cbfb95-6c5a-4057-ae89-6a04e6dd8a1b | | fa:16:3e:39:16:85 | ip_address='10.128.55.107', subnet_id='531d14b7-5d25-446b-8e25-1ac96005e801' | DOWN | | 2042113b-1844-4f2b-b434-b27912adf60b | | fa:16:3e:f2:9f:2a | ip_address='10.128.30.187', subnet_id='91cbb3bd-774a-430a-b68b-604ee259c118' | DOWN | | 2093c059-ad92-42c4-ac31-ea1493859aaf | | fa:16:3e:76:f8:18 | ip_address='10.128.46.77', subnet_id='86a70bc2-c45a-4ced-8130-19fbb9fabf64' | DOWN | | 25b17da4-ce8f-40a8-b863-198cffef867f | | fa:16:3e:c8:59:da | ip_address='10.128.33.242', subnet_id='d1cc0d73-b7d8-47a6-a781-9a4016143865' | DOWN | | 2813434a-7f7e-4035-96ee-4516ac20be0e | | fa:16:3e:f8:70:44 | ip_address='10.128.55.203', subnet_id='531d14b7-5d25-446b-8e25-1ac96005e801' | DOWN | | 28145a66-a675-4320-9595-0e79a59da0d8 | | fa:16:3e:95:12:57 | ip_address='10.128.55.76', subnet_id='531d14b7-5d25-446b-8e25-1ac96005e801' | DOWN | | 31dfdcdf-8cdf-43ff-98ea-0ce928bc7f29 | | fa:16:3e:bb:4c:77 | ip_address='10.128.32.124', subnet_id='d1cc0d73-b7d8-47a6-a781-9a4016143865' | DOWN | | 389144e3-7f03-4769-90f2-3f8b17af177a | | fa:16:3e:7f:13:43 | ip_address='10.128.22.205', subnet_id='3f4795cd-e8a4-4668-9304-9731e7d45fe0' | DOWN | | 41952b0c-bc39-4b89-9069-c1b6e2ff5871 | | fa:16:3e:80:87:e0 | ip_address='10.128.55.25', subnet_id='531d14b7-5d25-446b-8e25-1ac96005e801' | DOWN | | 44cad2ec-fc43-47c6-914e-feb62f5e7137 | ostest-7vhfl-ingress-port | fa:16:3e:3e:d4:da | ip_address='10.196.0.7', subnet_id='4939e931-9854-4352-a259-dbf556adfb07' | DOWN | | 4f703c8e-4de2-4612-8268-3a31edd89ef7 | | fa:16:3e:5d:1c:eb | ip_address='10.128.65.167', subnet_id='b7504772-8ef0-44f7-ab15-72e1bcf10bb8' | DOWN | | 4ffb8c04-c320-4ecb-b439-08f849dc1932 | | fa:16:3e:47:4a:7b | ip_address='10.128.30.175', subnet_id='91cbb3bd-774a-430a-b68b-604ee259c118' | DOWN | | 56f75706-411f-4007-8323-8c16516770b2 | | fa:16:3e:0f:a1:01 | ip_address='10.128.32.103', subnet_id='d1cc0d73-b7d8-47a6-a781-9a4016143865' | DOWN | | 572a8dd9-eba8-4b23-99a0-db236b83f01c | | fa:16:3e:99:5c:eb | ip_address='10.128.65.251', subnet_id='b7504772-8ef0-44f7-ab15-72e1bcf10bb8' | DOWN | | 593ea2a2-c350-4c05-81eb-e797440d4f74 | | fa:16:3e:31:f0:a1 | ip_address='10.128.65.206', subnet_id='b7504772-8ef0-44f7-ab15-72e1bcf10bb8' | DOWN | | 622ca174-7f81-4c9d-b9a7-6fb72a1a6ea4 | | fa:16:3e:e6:c1:33 | ip_address='10.128.65.104', subnet_id='b7504772-8ef0-44f7-ab15-72e1bcf10bb8' | DOWN | | 766e04d1-9802-48c2-81a1-b832253956a0 | | fa:16:3e:09:2f:5f | ip_address='10.128.9.169', subnet_id='c04ac33f-0560-4a8a-9f32-9461331500eb' | DOWN | | 7c3edbe5-d431-45ff-8dc4-ccde3af24096 | | fa:16:3e:64:ba:10 | ip_address='10.128.103.96', subnet_id='42181d8d-fec9-4a96-85b4-fdaaaf015b32' | DOWN | | 8e107d1c-4903-45db-90c3-5ec995998909 | ostest-7vhfl-api-port | fa:16:3e:93:3f:27 | ip_address='10.196.0.5', subnet_id='4939e931-9854-4352-a259-dbf556adfb07' | DOWN | | 9222ef15-f027-477d-87a8-3cf61abf7974 | | fa:16:3e:ea:36:47 | ip_address='10.128.23.178', subnet_id='3f4795cd-e8a4-4668-9304-9731e7d45fe0' | DOWN | | 93c8c332-817b-43f6-b408-fb42f292887e | | fa:16:3e:a6:9a:91 | ip_address='10.128.65.199', subnet_id='b7504772-8ef0-44f7-ab15-72e1bcf10bb8' | DOWN | | 9c5c4180-476a-4d38-81a3-a9a7e1cb849a | | fa:16:3e:56:d8:de | ip_address='10.128.54.247', subnet_id='531d14b7-5d25-446b-8e25-1ac96005e801' | DOWN | | ae821759-86f9-4de9-9688-5a91177397f2 | ostest-7vhfl-worker-0-4qwmt | fa:16:3e:33:78:84 | ip_address='10.196.1.52', subnet_id='4939e931-9854-4352-a259-dbf556adfb07' | DOWN | | b6dda3e9-f0d5-4c5d-8ae1-13ea52e73275 | | fa:16:3e:1b:1e:67 | ip_address='10.128.23.22', subnet_id='3f4795cd-e8a4-4668-9304-9731e7d45fe0' | DOWN | | caa33d6f-ce88-4c68-a773-f96fd49adf92 | | fa:16:3e:a8:33:ba | ip_address='10.128.102.239', subnet_id='42181d8d-fec9-4a96-85b4-fdaaaf015b32' | DOWN | | d16f2a2e-418a-4fd8-b5c2-a18dae21cdda | | fa:16:3e:2c:ca:a2 | ip_address='10.128.46.92', subnet_id='86a70bc2-c45a-4ced-8130-19fbb9fabf64' | DOWN | | dfd357d6-fc27-4576-89bd-5378d3aec03d | | fa:16:3e:51:a3:3a | ip_address='10.128.64.118', subnet_id='b7504772-8ef0-44f7-ab15-72e1bcf10bb8' | DOWN | | dffe890e-0a23-4ab9-8be8-511f6c5b142d | | fa:16:3e:0e:ed:09 | ip_address='10.128.55.177', subnet_id='531d14b7-5d25-446b-8e25-1ac96005e801' | DOWN | | fa5c5d6b-1f78-4cca-9d48-60e3bb5588f6 | | fa:16:3e:3c:80:bf | ip_address='10.128.9.179', subnet_id='c04ac33f-0560-4a8a-9f32-9461331500eb' | DOWN | | fd50b8d0-5798-4bdf-b807-2d2cfb4cda89 | | fa:16:3e:c1:e6:6b | ip_address='10.128.24.117', subnet_id='32cf6760-056c-49a2-b675-db4d72c8de76' | DOWN | | fe0669bf-3837-4af1-96a8-3cfac978ee3f | | fa:16:3e:36:e9:5e | ip_address='10.128.24.227', subnet_id='32cf6760-056c-49a2-b675-db4d72c8de76' | DOWN | +--------------------------------------+-----------------------------+-------------------+-------------------------------------------------------------------------------+--------+ # Periodic task run successfully. No tracebacks observed on kuryr-controller: (overcloud) [stack@undercloud-0 ~]$ oc get nodes ; openstack port list --device-owner="" --tags="openshiftClusterID=ostest-7vhfl" NAME STATUS ROLES AGE VERSION ostest-7vhfl-master-0 Ready master 3h25m v1.19.0+beb741b ostest-7vhfl-master-1 Ready master 3h25m v1.19.0+beb741b ostest-7vhfl-master-2 Ready master 3h25m v1.19.0+beb741b ostest-7vhfl-worker-0-f2qjj Ready worker 176m v1.19.0+beb741b ostest-7vhfl-worker-0-smgph Ready worker 176m v1.19.0+beb741b +--------------------------------------+---------------------------+-------------------+---------------------------------------------------------------------------+--------+ | ID | Name | MAC Address | Fixed IP Addresses | Status | +--------------------------------------+---------------------------+-------------------+---------------------------------------------------------------------------+--------+ | 44cad2ec-fc43-47c6-914e-feb62f5e7137 | ostest-7vhfl-ingress-port | fa:16:3e:3e:d4:da | ip_address='10.196.0.7', subnet_id='4939e931-9854-4352-a259-dbf556adfb07' | DOWN | | 8e107d1c-4903-45db-90c3-5ec995998909 | ostest-7vhfl-api-port | fa:16:3e:93:3f:27 | ip_address='10.196.0.5', subnet_id='4939e931-9854-4352-a259-dbf556adfb07' | DOWN | +--------------------------------------+---------------------------+-------------------+---------------------------------------------------------------------------+--------+ $ openstack network trunk list +--------------------------------------+-----------------------------+--------------------------------------+-------------+ | ID | Name | Parent Port | Description | +--------------------------------------+-----------------------------+--------------------------------------+-------------+ | 311b4170-780a-49d3-9c5f-09a599c0b036 | ostest-7vhfl-worker-0-smgph | 5085a665-75d4-441d-9f2f-6fe3c8c2618a | | | 5b7b9b98-d0c2-4141-b1a7-59b2c3445171 | ostest-7vhfl-worker-0-f2qjj | eaec69c3-26e4-41a4-b6dc-1b6912019cf5 | | | 9b5807a0-d461-4292-97cb-a67fe612074d | ostest-7vhfl-master-trunk-2 | 01ad57e8-6af3-495b-a063-4f1bef126ef9 | | | b3fc0cfa-af63-485a-8d9b-4eec2cb411d8 | ostest-7vhfl-master-trunk-1 | 8a482f55-f895-4e5e-acde-d208ed2de511 | | | b6fc141a-6310-4137-b151-19ee03c7e514 | ostest-7vhfl-master-trunk-0 | f4b95048-fb04-4664-a70d-71c169ac01a5 | | +--------------------------------------+-----------------------------+--------------------------------------+-------------+ Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (OpenShift Container Platform 4.6 GA Images), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2020:4196 |