+++ This bug was initially created as a clone of Bug #1761572 +++ Description of problem: In an OVN deployment when ovsdb-server failover happens, it can happen that some ovn-controllers connect to the ovsdb-server master in read-only mode. Once the ovsdb-servers are promoted to master, ideally ovn-controller should reconnect again and have read-write access to the db. But some times, the connection is not reset and these ovn-controller remain connected to the ovsdb-servers' in read-only mode. Because of which they cannot write to the SB db. This causes VM boot failures and mac_binding write failures. Version-Release number of selected component (if applicable): How reproducible: Steps to Reproduce: 1. 2. 3. Actual results: Expected results: Additional info:
[root@dell-per730-42 ovn]# uname -a Linux dell-per730-42.rhts.eng.pek2.redhat.com 3.10.0-1101.el7.x86_64 #1 SMP Sat Oct 5 04:50:26 EDT 2019 x86_64 x86_64 x86_64 GNU/Linux [root@dell-per730-42 ovn]# [root@dell-per730-42 ~]# rpm -qa | grep openvswitch kernel-kernel-networking-openvswitch-ovs_qinq-1.3-34.noarch openvswitch-selinux-extra-policy-1.0-14.el7fdp.noarch openvswitch2.12-2.12.0-3.el7fdp.x86_64 [root@dell-per730-42 ~]# rpm -qa | grep ovn ovn2.12-host-2.12.0-3.el7fdp.x86_64 ovn2.12-central-2.12.0-3.el7fdp.x86_64 ovn2.12-2.12.0-3.el7fdp.x86_64 [root@dell-per730-42 ~]# [root@dell-per730-42 ~]# ovn-nbctl --detach /var/run/openvswitch/ovn-nbctl.43870.ctl [root@dell-per730-42 ~]# NB_PATH=/var/run/openvswitch/ovn-nbctl.43870.ctl [root@dell-per730-42 ~]# ovs-appctl -t $NB_PATH run ls-add test [root@dell-per730-42 ovn]# ovs-appctl -t /var/run/ovn/ovnnb_db.ctl ovsdb-server/set-active-ovsdb-server tcp:192.0.2.254:6641 [root@dell-per730-42 ovn]# ovs-appctl -t /var/run/ovn/ovnnb_db.ctl ovsdb-server/connect-active-ovsdb-server [root@dell-per730-42 ovn]# ovs-appctl -t $NB_PATH run ls-add test1 transaction error: {"details":"insert operation not allowed when database server is in read only mode","error":"not allowed"} ovs-appctl: /var/run/openvswitch/ovn-nbctl.43870.ctl: server returned an error [root@dell-per730-42 ovn]# ovs-appctl -t /var/run/ovn/ovnnb_db.ctl ovsdb-server/disconnect-active-ovsdb-server [root@dell-per730-42 ovn]# ovs-appctl -t $NB_PATH run ls-add test2 [root@dell-per730-42 ovn]# ovn-nbctl show switch 75b678fd-c85a-4b63-a069-cecdd598af33 (test) switch 0bb0c357-65c4-48f7-8c76-a756968c9e2a (test2) [root@dell-per730-42 ovn]#
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2019:4206