Bug 2203811

Summary:	[OVN] Spam of "openvswitch: ovs-system: deferred action limit reached, drop recirc action" messages in controller logs
Product:	Red Hat Enterprise Linux Fast Datapath	Reporter:	Alex Stupnikov <astupnik>
Component:	ovn-2021	Assignee:	OVN Team <ovnteam>
Status:	NEW ---	QA Contact:	Jianlin Shi <jishi>
Severity:	medium	Docs Contact:
Priority:	high
Version:	FDP 21.A	CC:	apevec, ctrautma, cylopez, dalvarez, echaudro, jiji, jlibosva, lhh, majopela, mlavalle, mmichels, ovnteam, scohen
Target Milestone:	---	Flags:	cylopez: needinfo? (ovnteam) cylopez: needinfo? (ovnteam)
Target Release:	---
Hardware:	All
OS:	All
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:		Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Alex Stupnikov 2023-05-15 10:14:26 UTC

Description of problem:
While investigating performance problem for one of our VIP customers we found out that openvswitch sends numerous messages like [1] to /var/log/messages on controller nodes. Since controller nodes are not actually forwarding significant amount of traffic in customer's case (ML2/OVN with DVR), these messages doesn't seem to be a root cause of customer's issues.

At the same time OVN discussions like https://mail.openvswitch.org/pipermail/ovs-discuss/2021-August/051345.html makes me think that something is wrong and there is possible routing loop.

I am reporting this bugzilla to ask for your opinion about messages [1] and for your advice about next steps: logged messages look too generic for me and I am not sure how to identify OVN entities possibly affected by them.

[1]
May  2 04:18:05 HOSTNAME kernel: openvswitch: ovs-system: deferred action limit reached, drop recirc action


Version-Release number of selected component (if applicable):
Red Hat OpenStack Platform release 16.2.4

Additional info:
sosreports from controller nodes are attached to support case.

Comment 1 Alex Stupnikov 2023-05-15 12:54:11 UTC

We also have /var/lib/openvswitch/ovn/ folder from controller node attached to case.