reproduced on version:
# rpm -qa|grep ovn23.06
ovn23.06-23.06.0-36.el9fdp.x86_64
ovn23.06-central-23.06.0-36.el9fdp.x86_64
ovn23.06-host-23.06.0-36.el9fdp.x86_64

as   said in email,we can test as below to hit the issue:
        ovn-appctl -t ovn-controller debug/pause

        sleep 5
        ovn-nbctl --wait=sb lsp-add ls lsp0
        ovn-nbctl --wait=sb lsp-del lsp0
        ovn-appctl  -t ovn-controller debug/resume
        sleep 5
 now,       cat /var/log/ovn/ovn-controller.log|grep WARN
2023-08-21T12:33:15.584Z|00011|rconn|WARN|unix:/run/openvswitch/br-int.mgmt: connection failed (No such file or directory)
2023-08-21T12:33:15.584Z|00015|rconn|WARN|unix:/run/openvswitch/br-int.mgmt: connection failed (No such file or directory)
2023-08-21T12:33:23.000Z|00032|if_status|WARN|Trying to release unknown interface lsp0   ----------we can see this warning


verified on version:
# rpm -qa|grep ovn23.06
ovn23.06-23.06.0-56.el9fdp.x86_64
ovn23.06-central-23.06.0-56.el9fdp.x86_64
ovn23.06-host-23.06.0-56.el9fdp.x86_64

we can not see the warning now:
cat /var/log/ovn/ovn-controller.log|grep WARN
2023-08-21T12:18:30.560Z|00011|rconn|WARN|unix:/run/openvswitch/br-int.mgmt: connection failed (No such file or directory)
2023-08-21T12:18:30.561Z|00015|rconn|WARN|unix:/run/openvswitch/br-int.mgmt: connection failed (No such file or directory)

set verified.

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (ovn23.06 bug fix and enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2023:5306