Bug 2005913

Summary: [4.7z] external gateway pod deletes may not clean up ECMP routes
Product: OpenShift Container Platform Reporter: Tim Rozet <trozet>
Component: NetworkingAssignee: Tim Rozet <trozet>
Networking sub component: ovn-kubernetes QA Contact: Ross Brattain <rbrattai>
Status: CLOSED ERRATA Docs Contact:
Severity: high    
Priority: high CC: aconstan, akaris, bhershbe, dblack, kholtz, rbrattai, surya, zzhao
Version: 4.6Keywords: FastFix
Target Milestone: ---   
Target Release: 4.7.z   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: 2004269 Environment:
Last Closed: 2021-09-29 14:10:11 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 2004269    
Bug Blocks:    

Comment 1 Ross Brattain 2021-09-20 19:00:02 UTC
Tested on https://github.com/openshift/ovn-kubernetes/pull/763

4.7.0-0.ci.test-2021-09-20-145757-ci-ln-8nfy93t-latest


Annotations:  k8s.ovn.org/routing-namespaces: exgw
              k8s.ovn.org/routing-network: blah
              k8s.v1.cni.cncf.io/network-status:
                [{"name":"blah","interface":"net1","ips":["172.31.249.174", "192.168.15.5"],"mac":"da:32:0c:8a:42:47","dns":{}}]




I0920 18:32:18.656877       1 egressgw.go:149] Deleting routes for external gateway pod: testpod1, for namespace(s) exgw
2021-09-20T18:32:18.659Z|01395|unixctl|DBG|received request run["--if-exists","--policy=src-ip","--","lr-route-del","GR_ip-10-0-140-1-1.compute.internal","10.129.2.18/32","172.31.249.174] id=0
2021-09-20T18:32:18.659Z|01396|nbctl|INFO|Running command run --if-exists --policy=src-ip -- lr-route-del GR_ip-10-0-140-1-1.compute.internal 10.129.2.18/32 172.31.249.174
2021-09-20T18:32:18.662Z|01397|unixctl|DBG|replying with success, id=0: ""
2021-09-20T18:32:18.665Z|01398|unixctl|DBG|received request run["--format=csv","--data=bare","--no-headings","--columns=bfd","--","find","Logical_Router_Static_Route","output_port=rtoe-GR_ip-10-0-140-1-1.compute.internal","nexthop=172.31.249.174","bfd!=[] id=0
2021-09-20T18:32:18.665Z|01399|nbctl|DBG|Running command run --format=csv --data=bare --no-headings --columns=bfd -- find Logical_Router_Static_Route output_port=rtoe-GR_ip-10-0-140-1-1.compute.internal nexthop=172.31.249.174 bfd!=[]
2021-09-20T18:32:18.665Z|01400|unixctl|DBG|replying with success, id=0: ""
2021-09-20T18:32:18.669Z|01401|unixctl|DBG|received request run["--format=csv","--data=bare","--no-headings","--columns=_uuid","--","find","BFD","logical_port=rtoe-GR_ip-10-0-140-1-1.compute.internal","dst_ip=172.31.249.174] id=0
2021-09-20T18:32:18.669Z|01402|nbctl|DBG|Running command run --format=csv --data=bare --no-headings --columns=_uuid -- find BFD logical_port=rtoe-GR_ip-10-0-140-1-1.compute.internal dst_ip=172.31.249.174
2021-09-20T18:32:18.669Z|01403|unixctl|DBG|replying with success, id=0: ""
I0920 18:32:18.669568       1 egressgw.go:486] Did not find bfd entry for rtoe-GR_ip-10-0-140-1-1.compute.internal 172.31.249.174
2021-09-20T18:32:18.671Z|01404|unixctl|DBG|received request run["--if-exists","--policy=src-ip","--","lr-route-del","GR_ip-10-0-140-1-1.compute.internal","10.129.2.18/32","192.168.15.5] id=0
2021-09-20T18:32:18.672Z|01405|nbctl|INFO|Running command run --if-exists --policy=src-ip -- lr-route-del GR_ip-10-0-140-1-1.compute.internal 10.129.2.18/32 192.168.15.5
2021-09-20T18:32:18.674Z|01406|unixctl|DBG|replying with success, id=0: ""
2021-09-20T18:32:18.677Z|01407|unixctl|DBG|received request run["--","lr-policy-del","ovn_cluster_router","501","inport] == \"rtos-ip-10-0-140-1-1.compute.internal\" && ip4.src == 10.129.2.18 && ip4.dst != 10.128.0.0/14"], id=0
2021-09-20T18:32:18.677Z|01408|nbctl|INFO|Running command run -- lr-policy-del ovn_cluster_router 501 "inport == \"rtos-ip-10-0-140-1-1.compute.internal\" && ip4.src == 10.129.2.18 && ip4.dst != 10.128.0.0/14"
2021-09-20T18:32:18.681Z|01409|unixctl|DBG|replying with success, id=0: ""
2021-09-20T18:32:18.685Z|01410|unixctl|DBG|received request run["--format=csv","--data=bare","--no-headings","--columns=bfd","--","find","Logical_Router_Static_Route","output_port=rtoe-GR_ip-10-0-140-1-1.compute.internal","nexthop=192.168.15.5","bfd!=[] id=0
2021-09-20T18:32:18.685Z|01411|nbctl|DBG|Running command run --format=csv --data=bare --no-headings --columns=bfd -- find Logical_Router_Static_Route output_port=rtoe-GR_ip-10-0-140-1-1.compute.internal nexthop=192.168.15.5 bfd!=[]
2021-09-20T18:32:18.685Z|01412|unixctl|DBG|replying with success, id=0: ""
2021-09-20T18:32:18.688Z|01413|unixctl|DBG|received request run["--format=csv","--data=bare","--no-headings","--columns=_uuid","--","find","BFD","logical_port=rtoe-GR_ip-10-0-140-1-1.compute.internal","dst_ip=192.168.15.5] id=0
2021-09-20T18:32:18.688Z|01414|nbctl|DBG|Running command run --format=csv --data=bare --no-headings --columns=_uuid -- find BFD logical_port=rtoe-GR_ip-10-0-140-1-1.compute.internal dst_ip=192.168.15.5
2021-09-20T18:32:18.688Z|01415|unixctl|DBG|replying with success, id=0: ""
I0920 18:32:18.689267       1 egressgw.go:486] Did not find bfd entry for rtoe-GR_ip-10-0-140-1-1.compute.internal 192.168.15.5
I0920 18:32:27.378557       1 reflector.go:530] k8s.io/client-go/informers/factory.go:134: Watch close - *v1.Pod total 41 items received

Comment 6 errata-xmlrpc 2021-09-29 14:10:11 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Container Platform 4.7.32 bug fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:3636