Bug 1979795
| Summary: | After update to latest version, logs are filled with "RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it" | ||
|---|---|---|---|
| Product: | Red Hat OpenStack | Reporter: | vivek koul <vkoul> |
| Component: | openstack-neutron | Assignee: | OSP Team <rhos-maint> |
| Status: | CLOSED DUPLICATE | QA Contact: | Eran Kuris <ekuris> |
| Severity: | medium | Docs Contact: | |
| Priority: | medium | ||
| Version: | 16.1 (Train) | CC: | chrisw, lmartins, pambre, scohen |
| Target Milestone: | --- | ||
| Target Release: | --- | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | If docs needed, set a value | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2021-07-12 12:30:12 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
*** This bug has been marked as a duplicate of bug 1956074 *** |
Description of problem: After doing a minor update on OpenStack environment from 16.1.3 to 16.1.6, observing the following errors in /var/log/containers/neutron/server.log every 10 minutes on 2/3 controllers from the cluster: ~~~ 2021-07-05 09:41:56.274 39 ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 128, in run txn.results.put(txn.do_commit()) File "/usr/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 115, in do_commit raise RuntimeError(msg) RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.6/site-packages/ovsdbapp/api.py", line 111, in transaction 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command yield self._nested_txns_map[cur_thread_id] 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command KeyError: 139964802373784 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command During handling of the above exception, another exception occurred: 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 42, in execute 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command t.add(self) 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib64/python3.6/contextlib.py", line 88, in __exit__ 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.6/site-packages/networking_ovn/ovsdb/impl_idl_ovn.py", line 183, in transaction 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command yield t 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib64/python3.6/contextlib.py", line 88, in __exit__ 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.6/site-packages/ovsdbapp/api.py", line 119, in transaction 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command del self._nested_txns_map[cur_thread_id] 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.6/site-packages/ovsdbapp/api.py", line 69, in __exit__ 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 62, in commit 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command raise result.ex 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 128, in run 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 115, in do_commit 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it 2021-07-05 09:41:56.275 39 ERROR ovsdbapp.backend.ovs_idl.command ~~~ Version-Release number of selected component (if applicable): ~~~ less installed-rpms | grep neutron puppet-neutron-15.5.1-1.20210323133456.7d0406b.el8ost.noarch Fri Jul 2 16:25:12 2021 python3-neutronclient-6.14.1-1.20201113231846.a09e824.el8ost.noarch Fri Jul 2 16:26:03 2021 less installed-rpms | grep ovn puppet-ovn-15.4.1-1.20201113171358.192ac4e.el8ost.noarch Fri Jul 2 16:25:08 2021 cat /etc/redhat-release Red Hat Enterprise Linux release 8.2 (Ootpa) cat /etc/rhosp-release Red Hat OpenStack Platform release 16.1.6 GA (Train) ~~~ How reproducible: NA Steps to Reproduce: 1. 2. 3. Actual results: Logs filled with Tracebacks Expected results: No tracebacks Additional info: NA