2107645 – [4.8z] BACKPORT Delete Stale container interfaces on hard reboot

Bug 2107645 - [4.8z] BACKPORT Delete Stale container interfaces on hard reboot

Summary: [4.8z] BACKPORT Delete Stale container interfaces on hard reboot

Keywords:
Status:	CLOSED ERRATA
Alias:	None
Product:	OpenShift Container Platform
Classification:	Red Hat
Component:	Networking
Sub Component:
Version:	4.8
Hardware:	Unspecified
OS:	Unspecified
Priority:	high
Severity:	high
Target Milestone:	---
Target Release:	4.8.z
Assignee:	Tim Rozet
QA Contact:	Ross Brattain
Docs Contact:
URL:
Whiteboard:
Depends On:	2042494
Blocks:	1986216
TreeView+	depends on / blocked

Reported:	2022-07-15 15:09 UTC by Tim Rozet
Modified:	2022-08-10 13:43 UTC (History)
CC List:	5 users (show)
Fixed In Version:
Doc Type:	If docs needed, set a value
Doc Text:
Clone Of:	2042494
Environment:
Last Closed:	2022-08-09 12:52:44 UTC
Target Upstream Version:
Embargoed:

Attachments	(Terms of Use)

Links
System	ID	Private	Priority	Status	Summary	Last Updated
Github	openshift ovn-kubernetes pull 1197	0	None	Merged	Bug 2107645: Set the OVS port as transient	2022-07-21 17:00:49 UTC
Red Hat Product Errata	RHBA-2022:5889	0	None	None	None	2022-08-09 12:52:59 UTC

Comment 1 Ross Brattain 2022-07-19 22:47:59 UTC

Tested on 4.8.0-0.ci.test-2022-07-19-153112-ci-ln-hs3j60b-latest

❯ oc rsh ovnkube-node-x6kzz
Defaulted container "ovn-controller" out of: ovn-controller, ovn-acl-logging, kube-rbac-proxy, ovnkube-node
sh-4.4# ovs-vsctl --format=table --columns=_uuid,other_config find Port
_uuid                                other_config
------------------------------------ ------------------
12aac800-6376-4c9a-8102-16b6a38d75b1 {}
dbb052b1-35bb-44b6-a62a-3d355e168f39 {transient="true"}
d86ead41-c61d-404c-a458-ec7fae6c0e84 {transient="true"}
572598b1-ba0b-4f61-abeb-df09e8d521fe {transient="true"}
cfdd0522-9a2d-4fb9-8650-4ece99dceaa5 {}
f1cbe8e3-4783-49f4-83ce-bebd6e669462 {transient="true"}
97cc6dc3-1fca-4a91-820f-85015f969e2f {}
21c14a64-7a95-41be-a8d4-25eabac95f53 {transient="true"}
a586bf17-3157-497f-9aab-32080d4fc6fb {}
e103ee37-53bf-42fd-9f0f-5942219dafc0 {transient="true"}
5cd01db8-28b2-4717-81c1-eb0a14349ecc {}
11b09b78-901b-4678-9839-7426668876ea {transient="true"}
fa891888-e7f9-48dd-b323-4c353971df06 {transient="true"}
74735cb9-14f0-47a6-952b-21db031f94cc {}
cc358819-dcb0-46e8-8035-1b7f26bb6760 {}
6216c349-c62c-4293-87c2-3036a309c133 {}
2f38f75b-4ad5-429e-981b-7666a8a01103 {}
ac23da4c-46e6-4c70-ab77-c3549fa91c88 {transient="true"}
dcf4e5bc-8bae-4771-991c-8b7655e3dc6d {transient="true"}
05e7123c-e833-4775-a766-d860b2a4586d {transient="true"}
20870bbd-1ffd-47bb-a7f2-ae4a362ab83e {}
e58225dd-cd66-44c4-9959-3773251d6862 {}



❯ oc rsh ovnkube-node-x6kzz
Defaulted container "ovn-controller" out of: ovn-controller, ovn-acl-logging, kube-rbac-proxy, ovnkube-node
sh-4.4# ovs-vsctl --format=table --columns=_uuid,other_config find Port
_uuid                                other_config
------------------------------------ ------------------
12aac800-6376-4c9a-8102-16b6a38d75b1 {}
cfdd0522-9a2d-4fb9-8650-4ece99dceaa5 {}
35a02053-ad59-436a-9556-405a589bbf6e {transient="true"}
97cc6dc3-1fca-4a91-820f-85015f969e2f {}
5e574fa4-8508-4055-b8b6-5b79d3ad65cb {transient="true"}
64161dc4-6fdd-4cab-b197-1bce051d1c8a {}
d81772a5-833d-4d2e-af34-64a284fefd2e {transient="true"}
fb1324b6-4a55-413d-ae4d-57fac81d8c49 {transient="true"}
c374e567-3b21-4e4e-9e7d-be9802cf59e8 {transient="true"}
5cd01db8-28b2-4717-81c1-eb0a14349ecc {}
5408d198-a800-4d70-ae58-9b36be32f341 {}
74735cb9-14f0-47a6-952b-21db031f94cc {}
7d855289-a947-4168-9c1a-234189ec5587 {transient="true"}
6216c349-c62c-4293-87c2-3036a309c133 {}
2f38f75b-4ad5-429e-981b-7666a8a01103 {}
ff22138c-2444-410a-a2dc-6c5baf1bf69b {transient="true"}
60ae790c-209b-453b-a2c6-6427ee4c2831 {transient="true"}
009ff8fc-6861-4c93-8c9a-810e1f487419 {transient="true"}
20870bbd-1ffd-47bb-a7f2-ae4a362ab83e {}
e58225dd-cd66-44c4-9959-3773251d6862 {}
0014745d-6e88-4117-bc9f-4835d5e4e0f7 {transient="true"}
dfdcb63f-338e-4094-a039-f65700169b69 {transient="true"}


before                                                          after
_uuid                                other_config               _uuid                                other_config
------------------------------------ ------------------         ------------------------------------ ------------------
12aac800-6376-4c9a-8102-16b6a38d75b1 {}                         12aac800-6376-4c9a-8102-16b6a38d75b1 {}
dbb052b1-35bb-44b6-a62a-3d355e168f39 {transient="true"}       <
d86ead41-c61d-404c-a458-ec7fae6c0e84 {transient="true"}       <
572598b1-ba0b-4f61-abeb-df09e8d521fe {transient="true"}       <
cfdd0522-9a2d-4fb9-8650-4ece99dceaa5 {}                         cfdd0522-9a2d-4fb9-8650-4ece99dceaa5 {}
f1cbe8e3-4783-49f4-83ce-bebd6e669462 {transient="true"}       | 35a02053-ad59-436a-9556-405a589bbf6e {transient="true"}
97cc6dc3-1fca-4a91-820f-85015f969e2f {}                         97cc6dc3-1fca-4a91-820f-85015f969e2f {}
21c14a64-7a95-41be-a8d4-25eabac95f53 {transient="true"}       | 5e574fa4-8508-4055-b8b6-5b79d3ad65cb {transient="true"}
a586bf17-3157-497f-9aab-32080d4fc6fb {}                       | 64161dc4-6fdd-4cab-b197-1bce051d1c8a {}
e103ee37-53bf-42fd-9f0f-5942219dafc0 {transient="true"}       | d81772a5-833d-4d2e-af34-64a284fefd2e {transient="true"}
                                                              > fb1324b6-4a55-413d-ae4d-57fac81d8c49 {transient="true"}
                                                              > c374e567-3b21-4e4e-9e7d-be9802cf59e8 {transient="true"}
5cd01db8-28b2-4717-81c1-eb0a14349ecc {}                         5cd01db8-28b2-4717-81c1-eb0a14349ecc {}
11b09b78-901b-4678-9839-7426668876ea {transient="true"}       | 5408d198-a800-4d70-ae58-9b36be32f341 {}
fa891888-e7f9-48dd-b323-4c353971df06 {transient="true"}       <
74735cb9-14f0-47a6-952b-21db031f94cc {}                         74735cb9-14f0-47a6-952b-21db031f94cc {}
cc358819-dcb0-46e8-8035-1b7f26bb6760 {}                       | 7d855289-a947-4168-9c1a-234189ec5587 {transient="true"}
6216c349-c62c-4293-87c2-3036a309c133 {}                         6216c349-c62c-4293-87c2-3036a309c133 {}
2f38f75b-4ad5-429e-981b-7666a8a01103 {}                         2f38f75b-4ad5-429e-981b-7666a8a01103 {}
ac23da4c-46e6-4c70-ab77-c3549fa91c88 {transient="true"}       | ff22138c-2444-410a-a2dc-6c5baf1bf69b {transient="true"}
dcf4e5bc-8bae-4771-991c-8b7655e3dc6d {transient="true"}       | 60ae790c-209b-453b-a2c6-6427ee4c2831 {transient="true"}
05e7123c-e833-4775-a766-d860b2a4586d {transient="true"}       | 009ff8fc-6861-4c93-8c9a-810e1f487419 {transient="true"}
20870bbd-1ffd-47bb-a7f2-ae4a362ab83e {}                         20870bbd-1ffd-47bb-a7f2-ae4a362ab83e {}
e58225dd-cd66-44c4-9959-3773251d6862 {}                         e58225dd-cd66-44c4-9959-3773251d6862 {}
                                                              > 0014745d-6e88-4117-bc9f-4835d5e4e0f7 {transient="true"}
                                                              > dfdcb63f-338e-4094-a039-f65700169b69 {transient="true"}




-- Logs begin at Tue 2022-07-19 20:57:23 UTC, end at Tue 2022-07-19 22:39:22 UTC. --
Jul 19 22:25:01.970951 localhost systemd[1]: Starting Open vSwitch Delete Transient Ports...
Jul 19 22:25:01.994941 localhost ovs-vsctl[1095]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port cb71b6e4dc8ac6c
Jul 19 22:25:02.004093 localhost ovs-vsctl[1096]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port ef37f568ced181b
Jul 19 22:25:02.013104 localhost ovs-vsctl[1097]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port 3395894d184d6be
Jul 19 22:25:02.021484 localhost ovs-vsctl[1098]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port 59298212375b23a
Jul 19 22:25:02.029818 localhost ovs-vsctl[1099]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port 373c34fbd16fc15
Jul 19 22:25:02.038176 localhost ovs-vsctl[1100]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port 98eb1aa17993abb
Jul 19 22:25:02.046499 localhost ovs-vsctl[1101]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port 913e45b696a24b9
Jul 19 22:25:02.054602 localhost ovs-vsctl[1102]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port b87331fda6a74fb
Jul 19 22:25:02.062579 localhost ovs-vsctl[1103]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port 56659b0f4fc9c24
Jul 19 22:25:02.074935 localhost ovs-vsctl[1104]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port 9b2c2211e4c58da
Jul 19 22:25:02.083198 localhost ovs-vsctl[1105]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port 2a02f3941ab5762
Jul 19 22:25:02.088185 localhost systemd[1]: Started Open vSwitch Delete Transient Ports.
Jul 19 22:30:27.519180 ip-10-0-209-194 systemd[1]: ovs-delete-transient-ports.service: Succeeded.
Jul 19 22:30:27.519816 ip-10-0-209-194 systemd[1]: Stopped Open vSwitch Delete Transient Ports.
Jul 19 22:30:27.520817 ip-10-0-209-194 systemd[1]: ovs-delete-transient-ports.service: Consumed 0 CPU time
-- Logs begin at Tue 2022-07-19 20:57:23 UTC, end at Tue 2022-07-19 22:39:22 UTC. --
Jul 19 22:34:57.477603 localhost systemd[1]: Starting Open vSwitch Delete Transient Ports...
Jul 19 22:34:57.501928 localhost ovs-vsctl[1098]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port a3da669587b89d8
Jul 19 22:34:57.510578 localhost ovs-vsctl[1099]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port 690137dd9bfa90c
Jul 19 22:34:57.518597 localhost ovs-vsctl[1100]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port c4c5bc503ffc2f6
Jul 19 22:34:57.526272 localhost ovs-vsctl[1101]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port 731b2008602e6ec
Jul 19 22:34:57.533961 localhost ovs-vsctl[1102]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port 33a2454e0510193
Jul 19 22:34:57.541762 localhost ovs-vsctl[1103]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port 629f62caab9852b
Jul 19 22:34:57.548795 localhost ovs-vsctl[1104]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port 159a0ea68dfcc76
Jul 19 22:34:57.556029 localhost ovs-vsctl[1105]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port 821a257a730427d
Jul 19 22:34:57.563386 localhost ovs-vsctl[1106]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port c84dd04d7e55463
Jul 19 22:34:57.570205 localhost ovs-vsctl[1107]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port ebd1277caa980fd
Jul 19 22:34:57.577316 localhost ovs-vsctl[1108]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --no-wait -- del-port 2e0ceb84b849e8a
Jul 19 22:34:57.581331 localhost systemd[1]: Started Open vSwitch Delete Transient Ports.


ovs-vsctl --format=table --no-headings   --columns=name,other_config find Port

Comment 3 Ross Brattain 2022-07-21 17:06:35 UTC

It looks like this is in 4.8.0-0.nightly-2022-07-20-093041

Maybe the ci bot is not working?

Setting verified

Comment 7 errata-xmlrpc 2022-08-09 12:52:44 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Container Platform 4.8.47 bug fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2022:5889

Note You need to log in before you can comment on or make changes to this bug.