https://github.com/ovn-org/ovn-kubernetes/pull/2659 should fix this bug, I've lgtm-ed it. Meanwhile assigning it to Dan since he did all the hard work + this is just a backport bug of 4.10 that's assigned to Dan.
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (OpenShift Container Platform 4.9.21 bug fix update), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2022:0488
*** Bug 2066949 has been marked as a duplicate of this bug. ***