Description of problem:
-----------------------
After update from 4.7.24 to 4.8.23 noticed ovs-configuration.service failed on one node:

systemctl status ovs-configuration.service
● ovs-configuration.service - Configures OVS with proper host networking configuration
   Loaded: loaded (/etc/systemd/system/ovs-configuration.service; enabled; vendor preset: disabled)
   Active: failed (Result: exit-code) since Thu 2021-12-02 16:56:34 UTC; 3h 8min ago
 Main PID: 5159 (code=exited, status=4)
      CPU: 1.838s

Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: ens4f1-slave-ovs-clone  b8d4c5ad-d5bf-4e53-9bc9-d7b2698939e3  ethernet       --
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: + nmcli conn down ovs-if-phys0
Dec 02 16:56:33 openshift-worker-3 configure-ovs.sh[5159]: Connection 'ovs-if-phys0' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/13)
Dec 02 16:56:33 openshift-worker-3 configure-ovs.sh[5159]: + nmcli conn up 52eecf5a-df5e-30ae-9ca1-6297f0239027
Dec 02 16:56:34 openshift-worker-3 configure-ovs.sh[5159]: Connection successfully activated (master waiting for slaves) (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/15)
Dec 02 16:56:34 openshift-worker-3 configure-ovs.sh[5159]: + exit 4
Dec 02 16:56:34 openshift-worker-3 systemd[1]: ovs-configuration.service: Main process exited, code=exited, status=4/NOPERMISSION
Dec 02 16:56:34 openshift-worker-3 systemd[1]: ovs-configuration.service: Failed with result 'exit-code'.
Dec 02 16:56:34 openshift-worker-3 systemd[1]: Failed to start Configures OVS with proper host networking configuration.
Dec 02 16:56:34 openshift-worker-3 systemd[1]: ovs-configuration.service: Consumed 1.838s CPU time

logs
----
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: ++ nmcli -g connection.master connection show uuid 9cf97363-4c2c-479b-8d0d-44b31feadcfa
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: Error: 9cf97363-4c2c-479b-8d0d-44b31feadcfa - no such connection profile.
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: + '[' '' '!=' bond0 ']'
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: + continue
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: + nmcli conn up br-ex
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/9)
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: + nmcli conn up ovs-if-phys0
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: Error: Connection activation failed: Authorization request cancelled
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: + handle_exit_error
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: + e=4
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: + '[' 4 -eq 0 ']'
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: + set +e
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: + nmcli c show
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: NAME                    UUID                                  TYPE           DEVICE
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: ovs-if-br-ex            3ab7b221-3220-455e-9775-01cedf291967  ovs-interface  br-ex
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: ovs-if-phys0            9dd33b81-cacd-443f-81f1-10b8d52a32d8  vlan           bond0.373
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: bond0                   52eecf5a-df5e-30ae-9ca1-6297f0239027  bond           bond0
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: br-ex                   2f3a6550-f5a5-42af-b85f-f19a5ce5bab7  ovs-bridge     br-ex
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: ens4f0                  8950883b-a416-360a-a597-cb308946aaa0  ethernet       ens4f0
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: ens4f1                  9b808a8b-13ba-3749-8b8b-6f6f208666a2  ethernet       ens4f1
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: ovs-port-br-ex          dfc193fe-ce2c-4d24-b1ab-41b64797dda7  ovs-port       br-ex
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: ovs-port-phys0          ff0ed087-063c-4879-b226-115ee6c8d295  ovs-port       bond0.373
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: Wired connection 1      d89f5837-343b-38a0-aeca-2689f75f117e  ethernet       --
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: bond0.373               3b3cccb0-d7a9-3546-b076-dbc701181e95  vlan           --
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: ens4f0-slave-ovs-clone  64eb39a9-0cd9-49a3-8717-7e0429fef08d  ethernet       --
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: ens4f1-slave-ovs-clone  b8d4c5ad-d5bf-4e53-9bc9-d7b2698939e3  ethernet       --
Dec 02 16:56:32 openshift-worker-3 configure-ovs.sh[5159]: + nmcli conn down ovs-if-phys0
Dec 02 16:56:33 openshift-worker-3 configure-ovs.sh[5159]: Connection 'ovs-if-phys0' successfully deactivated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/13)
Dec 02 16:56:33 openshift-worker-3 configure-ovs.sh[5159]: + nmcli conn up 52eecf5a-df5e-30ae-9ca1-6297f0239027
Dec 02 16:56:34 openshift-worker-3 configure-ovs.sh[5159]: Connection successfully activated (master waiting for slaves) (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/15)
Dec 02 16:56:34 openshift-worker-3 configure-ovs.sh[5159]: + exit 4
Dec 02 16:56:34 openshift-worker-3 systemd[1]: ovs-configuration.service: Main process exited, code=exited, status=4/NOPERMISSION
Dec 02 16:56:34 openshift-worker-3 systemd[1]: ovs-configuration.service: Failed with result 'exit-code'.
Dec 02 16:56:34 openshift-worker-3 systemd[1]: Failed to start Configures OVS with proper host networking configuration.
Dec 02 16:56:34 openshift-worker-3 systemd[1]: ovs-configuration.service: Consumed 1.838s CPU time


Version-Release number of selected component (if applicable):
-------------------------------------------------------------
OCP-4.8.23


Steps to Reproduce:
------------------
1. Install OCP 4.7.24
2. Perform OVN migration to 2nd interface
3. Run update to 4.8.23
4. Drain and reboot a node 

Actual results:
---------------
ovs-configuration.service fails

Expected results:
-----------------
ova-configuration.service succeeds


Additional info:
----------------
Baremetal setup: 3masters + 4 workers(divided in 2 MCPs), baremetal network IPv4 , provisioning network IPv6