Bug 1883166 - Ports that belong to deleted nodes are leftover
Summary: Ports that belong to deleted nodes are leftover
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Networking
Version: 4.6
Hardware: Unspecified
OS: Unspecified
medium
urgent
Target Milestone: ---
: 4.6.0
Assignee: Luis Tomas Bolivar
QA Contact: GenadiC
URL:
Whiteboard:
Depends On:
Blocks: 1883419 1883565 1883825 1883832
TreeView+ depends on / blocked
 
Reported: 2020-09-28 09:12 UTC by Luis Tomas Bolivar
Modified: 2020-10-27 16:46 UTC (History)
1 user (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2020-10-27 16:45:44 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github openshift kuryr-kubernetes pull 353 0 None closed Bug 1883166: Cleanup ports belonging to deleted nodes 2020-10-20 07:43:37 UTC
Github openshift kuryr-kubernetes pull 358 0 None closed Bug 1883166: Ensure only kuryr ports are cleaned up 2020-10-20 07:43:37 UTC
OpenStack gerrit 753264 0 None MERGED Cleanup ports belonging to deleted nodes 2020-10-11 02:29:08 UTC
Red Hat Product Errata RHBA-2020:4196 0 None None None 2020-10-27 16:46:07 UTC

Description Luis Tomas Bolivar 2020-09-28 09:12:54 UTC
Due to the use of pools, there may be ports that belongs to pools
associated to deleted nodes. Thus those ports are wasted as they
cannot be used.

Comment 2 rlobillo 2020-09-30 13:10:43 UTC
Failed on OCP4.6.0-0.nightly-2020-09-30-052433.

The installation is not completed because the cleanup_removed_nodes task on kuryr-controller is removing the API and the ingress ports.

The condition to identify the ports that need to be removed is below:

$ openstack port list --device-owner="" --tags="openshiftClusterID=ostest-6lmxj" --long 
+--------------------------------------+---------------------------+-------------------+---------------------------------------------------------------------------+--------+-----------------
---------------------+--------------+---------------------------------+
| ID                                   | Name                      | MAC Address       | Fixed IP Addresses                                                        | Status | Security Groups 
                     | Device Owner | Tags                            |
+--------------------------------------+---------------------------+-------------------+---------------------------------------------------------------------------+--------+-----------------
---------------------+--------------+---------------------------------+
| 5bb2ed13-736c-47a9-b748-bc2e6ac0239e | ostest-6lmxj-api-port     | fa:16:3e:a2:14:14 | ip_address='10.196.0.5', subnet_id='dad606a9-40a8-4073-930a-be719cf1dae1' | DOWN   | 52af0920-4121-4e
1c-b8a7-31677d63eacb |              | openshiftClusterID=ostest-6lmxj |
| d148eb97-bb7d-4f3e-9ad5-c7a2a05d36d3 | ostest-6lmxj-ingress-port | fa:16:3e:be:50:1d | ip_address='10.196.0.7', subnet_id='dad606a9-40a8-4073-930a-be719cf1dae1' | DOWN   | 9078438b-688c-40
3d-b056-0c38af913017 |              | openshiftClusterID=ostest-6lmxj |
+--------------------------------------+---------------------------+-------------------+---------------------------------------------------------------------------+--------+-----------------
---------------------+--------------+---------------------------------+

leading to their incorrect removal.

Comment 4 rlobillo 2020-10-02 11:34:45 UTC
Verified on OCP 4.6.0-0.nightly-2020-10-02-001427 on RHOS-16.1-RHEL-8-20200917.n.3 with OVN-Octavia.

On a given installation with 3 workers, these are the details for the three trunk ports:


$ openstack network trunk list
+--------------------------------------+-----------------------------+--------------------------------------+-------------+
| ID                                   | Name                        | Parent Port                          | Description |
+--------------------------------------+-----------------------------+--------------------------------------+-------------+
| 311b4170-780a-49d3-9c5f-09a599c0b036 | ostest-7vhfl-worker-0-smgph | 5085a665-75d4-441d-9f2f-6fe3c8c2618a |             |
| 5b7b9b98-d0c2-4141-b1a7-59b2c3445171 | ostest-7vhfl-worker-0-f2qjj | eaec69c3-26e4-41a4-b6dc-1b6912019cf5 |             |
| 9b5807a0-d461-4292-97cb-a67fe612074d | ostest-7vhfl-master-trunk-2 | 01ad57e8-6af3-495b-a063-4f1bef126ef9 |             |
| b00e2fd6-5663-4b29-a75b-733ff4afb705 | ostest-7vhfl-worker-0-4qwmt | ae821759-86f9-4de9-9688-5a91177397f2 |             |
| b3fc0cfa-af63-485a-8d9b-4eec2cb411d8 | ostest-7vhfl-master-trunk-1 | 8a482f55-f895-4e5e-acde-d208ed2de511 |             |
| b6fc141a-6310-4137-b151-19ee03c7e514 | ostest-7vhfl-master-trunk-0 | f4b95048-fb04-4664-a70d-71c169ac01a5 |             |
+--------------------------------------+-----------------------------+--------------------------------------+-------------+


# ostest-7vhfl-worker-0-smgph
$ openstack network subport list --trunk 311b4170-780a-49d3-9c5f-09a599c0b036
+--------------------------------------+-------------------+-----------------+
| Port                                 | Segmentation Type | Segmentation ID |
+--------------------------------------+-------------------+-----------------+
| bcf246f3-ac61-47a7-b56f-5955489cf57d | vlan              |              91 |
| 7c6cb2b1-4f64-43e5-99d4-c6ee34419acf | vlan              |             147 |
| e862bd43-b547-40c1-b5ae-9fd35767d0c5 | vlan              |             299 |
| b8493a02-e127-4740-a23e-8e7547978a1f | vlan              |             391 |
| 1c8283cd-464c-41ca-880e-de9ebe4d8bd0 | vlan              |             449 |
| cf7ec16e-91a1-42f8-bfc9-f921a33aa772 | vlan              |             751 |
| 294ffb94-1a68-47b2-96d8-6d4ff7c4d64b | vlan              |             821 |
| 3475ac48-80de-4830-8bb1-1a28016c7a76 | vlan              |             877 |
| 0fe77f36-dbe9-43b2-81b2-672a1be32481 | vlan              |            1010 |
| 44af1ff5-dbd8-4990-85d6-82054846ed60 | vlan              |            1049 |
| 5896ba5c-9287-4429-a517-a21447280eb6 | vlan              |            1085 |
| 03822dad-ef3f-448d-9037-cb5c6021adde | vlan              |            1299 |
| 7a650a42-226a-4ed6-97f2-b5932a92c5a4 | vlan              |            1703 |
| 8b755e24-44de-41d1-9a33-c136de805914 | vlan              |            1726 |
| f36ae904-a533-4898-8b6a-ab65b067f0c9 | vlan              |            1738 |
| 822e304d-0e61-4ca1-81c6-b07308a9ec60 | vlan              |            1850 |
| 38b20269-a381-4509-97d4-6f844ee7a9a7 | vlan              |            1914 |
| 86476c39-da28-48a0-ac18-8df236e24ed2 | vlan              |            2306 |
| 3bc935a8-466b-4f06-bf7b-7400ba0bde25 | vlan              |            2420 |
| 1f4df47c-b8dc-4814-8902-9bc18a8f956a | vlan              |            2429 |
| 548ef0f6-1a86-44cb-8118-eb70319a7561 | vlan              |            2677 |
| b7a32887-f382-4760-9329-7cdc45c86804 | vlan              |            2952 |
| d6788a59-3c7b-4a57-b536-0be818989152 | vlan              |            3059 |
| 1b918412-d9e7-4d9c-af13-200241b71204 | vlan              |            3073 |
| 13b3a67d-7118-46e9-9ddb-7e1eca81e8d7 | vlan              |            3299 |
| 460fd895-c662-42a0-a63f-0190aee1fc8d | vlan              |            3306 |
| 4774de1c-70ba-4b86-bd31-dce2446622c8 | vlan              |            3335 |
| f3593665-2b21-475c-80b2-564cf77a093a | vlan              |            3860 |
| a8c5652a-b803-4ae6-819d-796d857127bd | vlan              |            3915 |
| fe72c2ab-ff15-4264-ae1c-15203c856f3e | vlan              |            3993 |
+--------------------------------------+-------------------+-----------------+



# ostest-7vhfl-worker-0-f2qjj
$ openstack network subport list --trunk 5b7b9b98-d0c2-4141-b1a7-59b2c3445171
+--------------------------------------+-------------------+-----------------+
| Port                                 | Segmentation Type | Segmentation ID |
+--------------------------------------+-------------------+-----------------+
| 99baf6f0-7dff-4e9e-8010-7670d0bca56e | vlan              |              19 |
| 6f8a1f76-f1fd-4d7a-9e72-182aad049523 | vlan              |              60 |
| 23448c13-bef7-4140-8a87-f8ed3562a6c5 | vlan              |             117 |
| 2781570a-38ed-418f-a269-4160e49387d8 | vlan              |             168 |
| 3e698c67-90f9-42ef-9f8a-f7614a24c4fb | vlan              |             170 |
| 55b15bcb-a03a-4e51-a678-b7698e101bbb | vlan              |             376 |
| 07f91eb2-f613-419f-a793-c477432c8f23 | vlan              |             416 |
| 38e954c7-8199-4ad9-883a-a11abd56699d | vlan              |             461 |
| a2166b53-1f87-4ee9-a019-9009ae33d012 | vlan              |             540 |
| 0b3c04ff-c7e3-4326-b5f7-87fe81326614 | vlan              |             585 |
| bf4e56d0-f52e-4f5a-ad13-636cb685f18f | vlan              |             609 |
| 257a9696-a638-4fe1-b3fb-31f84632b8d6 | vlan              |             610 |
| 202e8cff-31c0-47dc-8dd7-9b21c5850161 | vlan              |             617 |
| 3e194c78-3515-4847-b9dd-a99037c75a0a | vlan              |             619 |
| 4b1ed9d9-05f2-4290-ac47-34d8dd8903b0 | vlan              |             636 |
| 177d1c8d-e33d-4103-9726-90f8db7e7780 | vlan              |             803 |
| 8880b8a6-f0ca-4de3-9325-66b6ed1e792c | vlan              |            1117 |
| 810522a0-3aea-4252-a810-d7f6b5a008f8 | vlan              |            1219 |
| 736c5741-ae2c-4aab-a362-2a74ef6a44ec | vlan              |            1363 |
| 8be49b97-10c7-4125-ae02-f18e00f742f1 | vlan              |            1396 |
| 4f974dea-2c6e-4968-87ed-3d11c75b67cd | vlan              |            1429 |
| 93ffc525-e84b-4604-8228-2dc5158f7c97 | vlan              |            1573 |
| 10e434f0-ecf6-4d5d-9c1e-741acc53f931 | vlan              |            1677 |
| dc753230-ccf8-4f3e-91d5-05102656cf2a | vlan              |            1756 |
| e233c7aa-613b-4b62-8c4b-42f2d5c9c35f | vlan              |            1788 |
| bf4957d5-3ce1-46e1-ba0d-f79eae622669 | vlan              |            1805 |
| 9219f45b-19a7-445f-a125-2003817e2aab | vlan              |            1862 |
| 93c43bc9-b56d-4d14-bd40-1d22c14225ab | vlan              |            1926 |
| 950a53a4-1375-4c4f-b961-eb81f078b6bd | vlan              |            2017 |
| 0453f8d4-555c-48cd-b0c9-289f518a7ff7 | vlan              |            2026 |
| 6b33e86c-3a43-4495-af5b-1b54cfc8be4d | vlan              |            2058 |
| 4eb6d580-0d97-4ae7-80ed-5dd99f20e6e6 | vlan              |            2087 |
| 477a9039-4651-4a7d-8851-dabd3824e15a | vlan              |            2093 |
| 4415f504-f69d-46f6-9bf7-822deffd4e60 | vlan              |            2199 |
| 30749d75-b584-41e8-a964-4c16d2b6d65c | vlan              |            2446 |
| 24c7ae31-bd17-4074-9091-953246f9cfd0 | vlan              |            2662 |
| df75ec21-81b4-46e2-a583-2c3124e48132 | vlan              |            2691 |
| 14e66a89-b568-4790-ad4a-194676f247ee | vlan              |            2703 |
| 81b93e99-c948-4545-a714-6cd7f1c30be4 | vlan              |            2791 |
| eea1bdd7-e92c-433f-8c71-1e8f41847ef3 | vlan              |            2953 |
| 92cdb128-7112-467d-b760-49efb4f33126 | vlan              |            3055 |
| bfd1b5ef-f0b9-4f25-8ca4-2ef9f2b5fa08 | vlan              |            3078 |
| 8a2c855b-388d-4c76-b259-6155e7b22a3b | vlan              |            3086 |
| 85975053-5f46-4313-b828-998764238b80 | vlan              |            3469 |
| bc5e2305-7a13-40ee-b104-196bf2992ae1 | vlan              |            3578 |
| 2f732fe9-11d3-44ec-9c64-02042884cf5c | vlan              |            3719 |
| fa82ab20-6382-40d5-9a43-0655752aa793 | vlan              |            3785 |
| 91c13e71-feaa-4d19-b119-48d936848cca | vlan              |            3835 |
| d2539b89-efa7-44ff-8171-aafa9a807bc5 | vlan              |            3852 |
| bb80dd91-18bf-4512-847a-6eb5202e9ddf | vlan              |            3863 |
| 45b3609c-cb3b-45e7-afb2-00757411cb23 | vlan              |            3911 |
| 4ec78486-8da5-4e75-8a8f-0192e444293c | vlan              |            3961 |
| 9468a7cb-2e7e-435c-91d8-46741ad9de2f | vlan              |            3994 |
| ba5842be-0af3-471f-9556-0a1235e4b40b | vlan              |            4006 |
+--------------------------------------+-------------------+-----------------+


# ostest-7vhfl-worker-0-4qwmt
$ openstack network subport list --trunk b00e2fd6-5663-4b29-a75b-733ff4afb705
+--------------------------------------+-------------------+-----------------+
| Port                                 | Segmentation Type | Segmentation ID |
+--------------------------------------+-------------------+-----------------+
| 072fc83d-1678-41f2-a01d-a4a8fa3723e5 | vlan              |              67 |
| 2093c059-ad92-42c4-ac31-ea1493859aaf | vlan              |             102 |
| 7c3edbe5-d431-45ff-8dc4-ccde3af24096 | vlan              |             155 |
| 9c5c4180-476a-4d38-81a3-a9a7e1cb849a | vlan              |             263 |
| dfa01a44-c033-48eb-894e-66d84d1ffd9d | vlan              |             317 |
| dffe890e-0a23-4ab9-8be8-511f6c5b142d | vlan              |             355 |
| 031ecd1c-baf8-4af8-81dd-0f6154fc82ac | vlan              |             471 |
| 2813434a-7f7e-4035-96ee-4516ac20be0e | vlan              |             653 |
| 19cbfb95-6c5a-4057-ae89-6a04e6dd8a1b | vlan              |             757 |
| dfd357d6-fc27-4576-89bd-5378d3aec03d | vlan              |             807 |
| 7498cc9f-0200-4665-a83f-964005663dca | vlan              |            1183 |
| 389144e3-7f03-4769-90f2-3f8b17af177a | vlan              |            1231 |
| 56f75706-411f-4007-8323-8c16516770b2 | vlan              |            1287 |
| 4f703c8e-4de2-4612-8268-3a31edd89ef7 | vlan              |            1486 |
| 09a90c4c-5185-4447-a40e-2a8be1c07728 | vlan              |            1500 |
| 622ca174-7f81-4c9d-b9a7-6fb72a1a6ea4 | vlan              |            1908 |
| caa33d6f-ce88-4c68-a773-f96fd49adf92 | vlan              |            2084 |
| 0335bf7f-646c-4922-b06b-55701aa31aaf | vlan              |            2088 |
| 572a8dd9-eba8-4b23-99a0-db236b83f01c | vlan              |            2106 |
| fe0669bf-3837-4af1-96a8-3cfac978ee3f | vlan              |            2127 |
| 02c39628-bdc0-4449-9c32-ab5d38bb8994 | vlan              |            2243 |
| 9222ef15-f027-477d-87a8-3cf61abf7974 | vlan              |            2262 |
| b6dda3e9-f0d5-4c5d-8ae1-13ea52e73275 | vlan              |            2269 |
| 18b2afcb-da90-402c-9438-6c00368a01d1 | vlan              |            2352 |
| 766e04d1-9802-48c2-81a1-b832253956a0 | vlan              |            2523 |
| fd50b8d0-5798-4bdf-b807-2d2cfb4cda89 | vlan              |            2525 |
| 25b17da4-ce8f-40a8-b863-198cffef867f | vlan              |            2825 |
| d16f2a2e-418a-4fd8-b5c2-a18dae21cdda | vlan              |            2851 |
| 74e6a8ef-85ba-4acf-b0a8-80a493b80b4e | vlan              |            2966 |
| 93c8c332-817b-43f6-b408-fb42f292887e | vlan              |            2993 |
| c190872a-e9ea-4ac6-9337-d231718249b7 | vlan              |            3133 |
| 28145a66-a675-4320-9595-0e79a59da0d8 | vlan              |            3202 |
| 454132d2-ae95-4835-a7ad-d39fd0bfe656 | vlan              |            3463 |
| 593ea2a2-c350-4c05-81eb-e797440d4f74 | vlan              |            3479 |
| 41952b0c-bc39-4b89-9069-c1b6e2ff5871 | vlan              |            3629 |
| 2042113b-1844-4f2b-b434-b27912adf60b | vlan              |            3786 |
| fa5c5d6b-1f78-4cca-9d48-60e3bb5588f6 | vlan              |            3794 |
| 4ffb8c04-c320-4ecb-b439-08f849dc1932 | vlan              |            3903 |
| 31dfdcdf-8cdf-43ff-98ea-0ce928bc7f29 | vlan              |            4092 |
+--------------------------------------+-------------------+-----------------+


Now, reducing the number of replicas in the machineset will remove the trunk and a job running periodically (every 60 seconds) on kuryr-controller will remove the subports.

Before removing the worker, we have:

$ openstack port list --device-owner="" --tags="openshiftClusterID=ostest-7vhfl" --long 
+--------------------------------------+---------------------------+-------------------+---------------------------------------------------------------------------+--------+--------------------------------------+--------------+---------------------------------+
| ID                                   | Name                      | MAC Address       | Fixed IP Addresses                                                        | Status | Security Groups                      | Device Owner | Tags                            |
+--------------------------------------+---------------------------+-------------------+---------------------------------------------------------------------------+--------+--------------------------------------+--------------+---------------------------------+
| 44cad2ec-fc43-47c6-914e-feb62f5e7137 | ostest-7vhfl-ingress-port | fa:16:3e:3e:d4:da | ip_address='10.196.0.7', subnet_id='4939e931-9854-4352-a259-dbf556adfb07' | DOWN   | aa716c98-31a6-431a-a252-4da6c591454f |              | openshiftClusterID=ostest-7vhfl |
| 8e107d1c-4903-45db-90c3-5ec995998909 | ostest-7vhfl-api-port     | fa:16:3e:93:3f:27 | ip_address='10.196.0.5', subnet_id='4939e931-9854-4352-a259-dbf556adfb07' | DOWN   | dcec4516-f80e-4e3a-8216-879bb7e1f401 |              | openshiftClusterID=ostest-7vhfl |
+--------------------------------------+---------------------------+-------------------+---------------------------------------------------------------------------+--------+--------------------------------------+--------------+---------------------------------+

Reducing replica to 2, ostest-7vhfl-worker-0-4qwmt is scheduled to be deleted:

$ oc edit machineset -n openshift-machine-api ostest-7vhfl-worker-0

$ oc get nodes ; openstack port list --device-owner="" --tags="openshiftClusterID=ostest-7vhfl"
NAME                          STATUS                     ROLES    AGE     VERSION
ostest-7vhfl-master-0         Ready                      master   3h20m   v1.19.0+beb741b
ostest-7vhfl-master-1         Ready                      master   3h20m   v1.19.0+beb741b
ostest-7vhfl-master-2         Ready                      master   3h20m   v1.19.0+beb741b
ostest-7vhfl-worker-0-4qwmt   Ready,SchedulingDisabled   worker   171m    v1.19.0+beb741b
ostest-7vhfl-worker-0-f2qjj   Ready                      worker   171m    v1.19.0+beb741b
ostest-7vhfl-worker-0-smgph   Ready                      worker   171m    v1.19.0+beb741b

# Ports from the trunk are detached waiting to be deleted by the periodic task:

$ openstack port list --device-owner="" --tags="openshiftClusterID=ostest-7vhfl"
+--------------------------------------+-----------------------------+-------------------+-------------------------------------------------------------------------------+--------+
| ID                                   | Name                        | MAC Address       | Fixed IP Addresses                                                            | Status |   [0/1956]
+--------------------------------------+-----------------------------+-------------------+-------------------------------------------------------------------------------+--------+
| 02c39628-bdc0-4449-9c32-ab5d38bb8994 |                             | fa:16:3e:8f:ff:e7 | ip_address='10.128.30.3', subnet_id='91cbb3bd-774a-430a-b68b-604ee259c118'    | DOWN   |
| 031ecd1c-baf8-4af8-81dd-0f6154fc82ac |                             | fa:16:3e:45:05:a0 | ip_address='10.128.102.49', subnet_id='42181d8d-fec9-4a96-85b4-fdaaaf015b32'  | DOWN   |
| 0335bf7f-646c-4922-b06b-55701aa31aaf |                             | fa:16:3e:0d:8f:95 | ip_address='10.128.24.116', subnet_id='32cf6760-056c-49a2-b675-db4d72c8de76'  | DOWN   |
| 072fc83d-1678-41f2-a01d-a4a8fa3723e5 |                             | fa:16:3e:10:83:98 | ip_address='10.128.8.5', subnet_id='c04ac33f-0560-4a8a-9f32-9461331500eb'     | DOWN   |
| 09a90c4c-5185-4447-a40e-2a8be1c07728 |                             | fa:16:3e:f0:16:ab | ip_address='10.128.47.193', subnet_id='86a70bc2-c45a-4ced-8130-19fbb9fabf64'  | DOWN   |
| 19cbfb95-6c5a-4057-ae89-6a04e6dd8a1b |                             | fa:16:3e:39:16:85 | ip_address='10.128.55.107', subnet_id='531d14b7-5d25-446b-8e25-1ac96005e801'  | DOWN   |
| 2042113b-1844-4f2b-b434-b27912adf60b |                             | fa:16:3e:f2:9f:2a | ip_address='10.128.30.187', subnet_id='91cbb3bd-774a-430a-b68b-604ee259c118'  | DOWN   |
| 2093c059-ad92-42c4-ac31-ea1493859aaf |                             | fa:16:3e:76:f8:18 | ip_address='10.128.46.77', subnet_id='86a70bc2-c45a-4ced-8130-19fbb9fabf64'   | DOWN   |
| 25b17da4-ce8f-40a8-b863-198cffef867f |                             | fa:16:3e:c8:59:da | ip_address='10.128.33.242', subnet_id='d1cc0d73-b7d8-47a6-a781-9a4016143865'  | DOWN   |
| 2813434a-7f7e-4035-96ee-4516ac20be0e |                             | fa:16:3e:f8:70:44 | ip_address='10.128.55.203', subnet_id='531d14b7-5d25-446b-8e25-1ac96005e801'  | DOWN   |
| 28145a66-a675-4320-9595-0e79a59da0d8 |                             | fa:16:3e:95:12:57 | ip_address='10.128.55.76', subnet_id='531d14b7-5d25-446b-8e25-1ac96005e801'   | DOWN   |
| 31dfdcdf-8cdf-43ff-98ea-0ce928bc7f29 |                             | fa:16:3e:bb:4c:77 | ip_address='10.128.32.124', subnet_id='d1cc0d73-b7d8-47a6-a781-9a4016143865'  | DOWN   |
| 389144e3-7f03-4769-90f2-3f8b17af177a |                             | fa:16:3e:7f:13:43 | ip_address='10.128.22.205', subnet_id='3f4795cd-e8a4-4668-9304-9731e7d45fe0'  | DOWN   |
| 41952b0c-bc39-4b89-9069-c1b6e2ff5871 |                             | fa:16:3e:80:87:e0 | ip_address='10.128.55.25', subnet_id='531d14b7-5d25-446b-8e25-1ac96005e801'   | DOWN   |
| 44cad2ec-fc43-47c6-914e-feb62f5e7137 | ostest-7vhfl-ingress-port   | fa:16:3e:3e:d4:da | ip_address='10.196.0.7', subnet_id='4939e931-9854-4352-a259-dbf556adfb07'     | DOWN   |
| 4f703c8e-4de2-4612-8268-3a31edd89ef7 |                             | fa:16:3e:5d:1c:eb | ip_address='10.128.65.167', subnet_id='b7504772-8ef0-44f7-ab15-72e1bcf10bb8'  | DOWN   |
| 4ffb8c04-c320-4ecb-b439-08f849dc1932 |                             | fa:16:3e:47:4a:7b | ip_address='10.128.30.175', subnet_id='91cbb3bd-774a-430a-b68b-604ee259c118'  | DOWN   |
| 56f75706-411f-4007-8323-8c16516770b2 |                             | fa:16:3e:0f:a1:01 | ip_address='10.128.32.103', subnet_id='d1cc0d73-b7d8-47a6-a781-9a4016143865'  | DOWN   |
| 572a8dd9-eba8-4b23-99a0-db236b83f01c |                             | fa:16:3e:99:5c:eb | ip_address='10.128.65.251', subnet_id='b7504772-8ef0-44f7-ab15-72e1bcf10bb8'  | DOWN   |
| 593ea2a2-c350-4c05-81eb-e797440d4f74 |                             | fa:16:3e:31:f0:a1 | ip_address='10.128.65.206', subnet_id='b7504772-8ef0-44f7-ab15-72e1bcf10bb8'  | DOWN   |
| 622ca174-7f81-4c9d-b9a7-6fb72a1a6ea4 |                             | fa:16:3e:e6:c1:33 | ip_address='10.128.65.104', subnet_id='b7504772-8ef0-44f7-ab15-72e1bcf10bb8'  | DOWN   |
| 766e04d1-9802-48c2-81a1-b832253956a0 |                             | fa:16:3e:09:2f:5f | ip_address='10.128.9.169', subnet_id='c04ac33f-0560-4a8a-9f32-9461331500eb'   | DOWN   |
| 7c3edbe5-d431-45ff-8dc4-ccde3af24096 |                             | fa:16:3e:64:ba:10 | ip_address='10.128.103.96', subnet_id='42181d8d-fec9-4a96-85b4-fdaaaf015b32'  | DOWN   |
| 8e107d1c-4903-45db-90c3-5ec995998909 | ostest-7vhfl-api-port       | fa:16:3e:93:3f:27 | ip_address='10.196.0.5', subnet_id='4939e931-9854-4352-a259-dbf556adfb07'     | DOWN   |
| 9222ef15-f027-477d-87a8-3cf61abf7974 |                             | fa:16:3e:ea:36:47 | ip_address='10.128.23.178', subnet_id='3f4795cd-e8a4-4668-9304-9731e7d45fe0'  | DOWN   |
| 93c8c332-817b-43f6-b408-fb42f292887e |                             | fa:16:3e:a6:9a:91 | ip_address='10.128.65.199', subnet_id='b7504772-8ef0-44f7-ab15-72e1bcf10bb8'  | DOWN   |
| 9c5c4180-476a-4d38-81a3-a9a7e1cb849a |                             | fa:16:3e:56:d8:de | ip_address='10.128.54.247', subnet_id='531d14b7-5d25-446b-8e25-1ac96005e801'  | DOWN   |
| ae821759-86f9-4de9-9688-5a91177397f2 | ostest-7vhfl-worker-0-4qwmt | fa:16:3e:33:78:84 | ip_address='10.196.1.52', subnet_id='4939e931-9854-4352-a259-dbf556adfb07'    | DOWN   |
| b6dda3e9-f0d5-4c5d-8ae1-13ea52e73275 |                             | fa:16:3e:1b:1e:67 | ip_address='10.128.23.22', subnet_id='3f4795cd-e8a4-4668-9304-9731e7d45fe0'   | DOWN   |
| caa33d6f-ce88-4c68-a773-f96fd49adf92 |                             | fa:16:3e:a8:33:ba | ip_address='10.128.102.239', subnet_id='42181d8d-fec9-4a96-85b4-fdaaaf015b32' | DOWN   |
| d16f2a2e-418a-4fd8-b5c2-a18dae21cdda |                             | fa:16:3e:2c:ca:a2 | ip_address='10.128.46.92', subnet_id='86a70bc2-c45a-4ced-8130-19fbb9fabf64'   | DOWN   |
| dfd357d6-fc27-4576-89bd-5378d3aec03d |                             | fa:16:3e:51:a3:3a | ip_address='10.128.64.118', subnet_id='b7504772-8ef0-44f7-ab15-72e1bcf10bb8'  | DOWN   |
| dffe890e-0a23-4ab9-8be8-511f6c5b142d |                             | fa:16:3e:0e:ed:09 | ip_address='10.128.55.177', subnet_id='531d14b7-5d25-446b-8e25-1ac96005e801'  | DOWN   |
| fa5c5d6b-1f78-4cca-9d48-60e3bb5588f6 |                             | fa:16:3e:3c:80:bf | ip_address='10.128.9.179', subnet_id='c04ac33f-0560-4a8a-9f32-9461331500eb'   | DOWN   |
| fd50b8d0-5798-4bdf-b807-2d2cfb4cda89 |                             | fa:16:3e:c1:e6:6b | ip_address='10.128.24.117', subnet_id='32cf6760-056c-49a2-b675-db4d72c8de76'  | DOWN   |
| fe0669bf-3837-4af1-96a8-3cfac978ee3f |                             | fa:16:3e:36:e9:5e | ip_address='10.128.24.227', subnet_id='32cf6760-056c-49a2-b675-db4d72c8de76'  | DOWN   |
+--------------------------------------+-----------------------------+-------------------+-------------------------------------------------------------------------------+--------+

# Periodic task run successfully. No tracebacks observed on kuryr-controller:

(overcloud) [stack@undercloud-0 ~]$ oc get nodes ; openstack port list --device-owner="" --tags="openshiftClusterID=ostest-7vhfl"
NAME                          STATUS   ROLES    AGE     VERSION
ostest-7vhfl-master-0         Ready    master   3h25m   v1.19.0+beb741b
ostest-7vhfl-master-1         Ready    master   3h25m   v1.19.0+beb741b
ostest-7vhfl-master-2         Ready    master   3h25m   v1.19.0+beb741b
ostest-7vhfl-worker-0-f2qjj   Ready    worker   176m    v1.19.0+beb741b
ostest-7vhfl-worker-0-smgph   Ready    worker   176m    v1.19.0+beb741b
+--------------------------------------+---------------------------+-------------------+---------------------------------------------------------------------------+--------+
| ID                                   | Name                      | MAC Address       | Fixed IP Addresses                                                        | Status |
+--------------------------------------+---------------------------+-------------------+---------------------------------------------------------------------------+--------+
| 44cad2ec-fc43-47c6-914e-feb62f5e7137 | ostest-7vhfl-ingress-port | fa:16:3e:3e:d4:da | ip_address='10.196.0.7', subnet_id='4939e931-9854-4352-a259-dbf556adfb07' | DOWN   |
| 8e107d1c-4903-45db-90c3-5ec995998909 | ostest-7vhfl-api-port     | fa:16:3e:93:3f:27 | ip_address='10.196.0.5', subnet_id='4939e931-9854-4352-a259-dbf556adfb07' | DOWN   |
+--------------------------------------+---------------------------+-------------------+---------------------------------------------------------------------------+--------+

$ openstack network trunk list
+--------------------------------------+-----------------------------+--------------------------------------+-------------+
| ID                                   | Name                        | Parent Port                          | Description |
+--------------------------------------+-----------------------------+--------------------------------------+-------------+
| 311b4170-780a-49d3-9c5f-09a599c0b036 | ostest-7vhfl-worker-0-smgph | 5085a665-75d4-441d-9f2f-6fe3c8c2618a |             |
| 5b7b9b98-d0c2-4141-b1a7-59b2c3445171 | ostest-7vhfl-worker-0-f2qjj | eaec69c3-26e4-41a4-b6dc-1b6912019cf5 |             |
| 9b5807a0-d461-4292-97cb-a67fe612074d | ostest-7vhfl-master-trunk-2 | 01ad57e8-6af3-495b-a063-4f1bef126ef9 |             |
| b3fc0cfa-af63-485a-8d9b-4eec2cb411d8 | ostest-7vhfl-master-trunk-1 | 8a482f55-f895-4e5e-acde-d208ed2de511 |             |
| b6fc141a-6310-4137-b151-19ee03c7e514 | ostest-7vhfl-master-trunk-0 | f4b95048-fb04-4664-a70d-71c169ac01a5 |             |
+--------------------------------------+-----------------------------+--------------------------------------+-------------+

Comment 7 errata-xmlrpc 2020-10-27 16:45:44 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Container Platform 4.6 GA Images), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:4196


Note You need to log in before you can comment on or make changes to this bug.