Bug 2171423

Summary:	[OVN SCALE] ovn-controller: OpenFlow flow explosion with 'hairpin_snat_ip' LBs
Product:	Red Hat Enterprise Linux Fast Datapath	Reporter:	Ilya Maximets <i.maximets>
Component:	ovn23.03	Assignee:	Ilya Maximets <i.maximets>
Status:	CLOSED ERRATA	QA Contact:	Jianlin Shi <jishi>
Severity:	high	Docs Contact:
Priority:	urgent
Version:	FDP 23.B	CC:	ctrautma, jhopper, jiji, jtaleric, surya
Target Milestone:	---
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:	ovn23.03-23.03.0-4.el8fdp	Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2023-07-06 20:05:24 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Ilya Maximets 2023-02-20 11:37:46 UTC

OpenShift 4.13 will configure 'hairpin_snat_ip' for every created Load Balancer
since this PR made its way downstream:
  https://github.com/ovn-org/ovn-kubernetes/pull/3178

However, current implementation of ovn-controller will create an OpenFlow rule
for every datapath for each VIP in case of 'hairpin_snat_ip', because we need
to handle the case where LBs with the same VIP are applied to different datapaths
and have different SNAT IPs.

In large scale setups with tens of thousands of LBs and hundreds of nodes, this
generates millions of OpenFlow rules, making ovn-controller choke and fall into
unrecoverable disconnection loop with poll intervals up to 200 seconds in
ovn-heater's density-heavy scenario with just 120 nodes.  It also generates rules
with thousands of conjunctions that do not fit into a single FLOW_MOD, breaking
the OpenFlow management communication:


2023-02-18T07:02:12.754Z|00693|ofp_msgs|WARN|received OFPT_BUNDLE_ADD_MESSAGE with incorrect length 8 (expected length at least 16 bytes)
2023-02-18T07:02:12.754Z|00694|ofctrl|INFO|OpenFlow error: OFPT_ERROR (OF1.5) (xid=0x30dfd): OFPBRC_BAD_LEN
***decode error: OFPBRC_BAD_LEN***
00000000  06 22 00 08 00 03 0d fd-                        |."......        |
2023-02-18T07:02:12.754Z|00695|ofp_msgs|WARN|unknown OpenFlow message (version 0, type 0)
2023-02-18T07:02:12.755Z|00696|ofctrl|INFO|OpenFlow error: OFPT_ERROR (xid=0x3): OFPBRC_BAD_VERSION
***decode error: OFPBRC_BAD_TYPE***
00000000  00 00 1d cd 00 00 00 03-06 0e ff f8 00 03 0d fd |................|
00000010  00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00 |................|
00000020  46 02 00 00 00 00 00 c8-ff ff ff ff ff ff ff ff |F...............|
00000030  ff ff ff ff 00 00 00 00-00 01 00 10 80 00 04 08 |................|
00000040  00 00 00 00 00 00 00 c9-00 04 ff b8 00 00 00 00 |................|
00000050  ff ff 00 10 00 00 23 20-00 22 00 02 00 00 00 01 |......# ."......|
00000060  ff ff 00 10 00 00 23 20-00 22 00 02 00 00 00 02 |......# ."......|
00000070  ff ff 00 10 00 00 23 20-00 22 00 02 00 00 00 03 |......# ."......|
00000080  ff ff 00 10 00 00 23 20-00 22 00 02 00 00 00 01 |......# ."......|
...
2023-02-18T07:02:12.765Z|00703|rconn|WARN|unix:/var/run/openvswitch/br-int.mgmt: connection dropped (Connection reset by peer)
2023-02-18T07:05:33.535Z|00704|inc_proc_eng|INFO|node: logical_flow_output, recompute (failed handler for input port_groups) took 200697ms
2023-02-18T07:05:33.626Z|00705|ofctrl|WARN|req_cfg regressed from 39 to 0
2023-02-18T07:05:33.626Z|00706|memory_trim|INFO|Detected inactivity (last active 201054 ms ago): trimming memory
2023-02-18T07:05:33.627Z|00707|timeval|WARN|Unreasonably long 200874ms poll interval (199995ms user, 305ms system)

After that ovn-controller cannot function correctly until the cluster is
scaled down.

Comment 1 Ilya Maximets 2023-02-20 11:44:26 UTC

Sent a potential fix for the ovn-kubernetes' use case:
  https://patchwork.ozlabs.org/project/ovn/patch/20230220114200.614706-1-i.maximets@ovn.org/

Comment 2 Joe Talerico 2023-02-20 21:06:48 UTC

(In reply to Ilya Maximets from comment #0)
> OpenShift 4.13 will configure 'hairpin_snat_ip' for every created Load
> Balancer
> since this PR made its way downstream:
>   https://github.com/ovn-org/ovn-kubernetes/pull/3178
> 
> However, current implementation of ovn-controller will create an OpenFlow
> rule
> for every datapath for each VIP in case of 'hairpin_snat_ip', because we need
> to handle the case where LBs with the same VIP are applied to different
> datapaths
> and have different SNAT IPs.
> 
> In large scale setups with tens of thousands of LBs and hundreds of nodes,
> this
> generates millions of OpenFlow rules, making ovn-controller choke and fall
> into
> unrecoverable disconnection loop with poll intervals up to 200 seconds in
> ovn-heater's density-heavy scenario with just 120 nodes.  


I was able to hit this issue on a relatively small cluster (24 nodes). 

<shared must-gather on slack, as I cannot share it here>

Comment 3 Ilya Maximets 2023-03-02 10:20:40 UTC

v2 with an alternative solution posted here:
  https://patchwork.ozlabs.org/project/ovn/patch/20230301223600.1607778-1-i.maximets@ovn.org/

Comment 4 Surya Seetharaman 2023-03-06 19:09:31 UTC

increasing priority to urgent because we need this fixed in 2 sprints; we shouldn't be releasing OCP 4.13 without this IMHO?

Comment 5 Ilya Maximets 2023-03-06 20:17:08 UTC

FWIW, the patch was accepted upstream and is part of the 23.03 release:
  https://github.com/ovn-org/ovn/commit/faf3a90960dc39f82a26fe6e965425c66c3dc627

BZ should be picked up with the next downstream sync.

Comment 6 OVN Bot 2023-03-07 05:08:16 UTC

ovn23.03 fast-datapath-rhel-9 clone created at https://bugzilla.redhat.com/show_bug.cgi?id=2175998

Comment 9 Jianlin Shi 2023-04-26 01:18:30 UTC

Verified on ovn23.03-23.03.0-24.el8:

+ ovs-ofctl dump-flows br-int
+ grep 8.8.8.7
 cookie=0x47b5ab11, duration=0.102s, table=68, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_mark=0x2/0x2,ip,reg1=0xac110102,nw_src=192.168.1.1,nw_dst=192.168.1.1 actions=load:0x1->NXM_NX_REG10[7],learn(table=69,delete_learned,cookie=0x47b5ab11,OXM_OF_METADATA[],eth_type=0x800,NXM_OF_IP_SRC[],ip_dst=8.8.8.7,NXM_OF_IP_PROTO[],load:0x1->NXM_NX_REG10[7])
 cookie=0x9ddfd940, duration=0.102s, table=68, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_mark=0x2/0x2,ip,reg1=0xac110107,nw_src=192.168.1.1,nw_dst=192.168.1.1 actions=load:0x1->NXM_NX_REG10[7],learn(table=69,delete_learned,cookie=0x9ddfd940,OXM_OF_METADATA[],eth_type=0x800,NXM_OF_IP_SRC[],ip_dst=8.8.8.7,NXM_OF_IP_PROTO[],load:0x1->NXM_NX_REG10[7])
 cookie=0xb9b025c2, duration=0.101s, table=68, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_mark=0x2/0x2,ip,reg1=0xac110103,nw_src=192.168.1.1,nw_dst=192.168.1.1 actions=load:0x1->NXM_NX_REG10[7],learn(table=69,delete_learned,cookie=0xb9b025c2,OXM_OF_METADATA[],eth_type=0x800,NXM_OF_IP_SRC[],ip_dst=8.8.8.7,NXM_OF_IP_PROTO[],load:0x1->NXM_NX_REG10[7])
 cookie=0x9f06a7ea, duration=0.101s, table=68, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_mark=0x2/0x2,ip,reg1=0xac110104,nw_src=192.168.1.1,nw_dst=192.168.1.1 actions=load:0x1->NXM_NX_REG10[7],learn(table=69,delete_learned,cookie=0x9f06a7ea,OXM_OF_METADATA[],eth_type=0x800,NXM_OF_IP_SRC[],ip_dst=8.8.8.7,NXM_OF_IP_PROTO[],load:0x1->NXM_NX_REG10[7])
 cookie=0x540c4884, duration=0.101s, table=68, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_mark=0x2/0x2,ip,reg1=0xac110101,nw_src=192.168.1.1,nw_dst=192.168.1.1 actions=load:0x1->NXM_NX_REG10[7],learn(table=69,delete_learned,cookie=0x540c4884,OXM_OF_METADATA[],eth_type=0x800,NXM_OF_IP_SRC[],ip_dst=8.8.8.7,NXM_OF_IP_PROTO[],load:0x1->NXM_NX_REG10[7])
 cookie=0xf7444fc9, duration=0.101s, table=68, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_mark=0x2/0x2,ip,reg1=0xac110108,nw_src=192.168.1.1,nw_dst=192.168.1.1 actions=load:0x1->NXM_NX_REG10[7],learn(table=69,delete_learned,cookie=0xf7444fc9,OXM_OF_METADATA[],eth_type=0x800,NXM_OF_IP_SRC[],ip_dst=8.8.8.7,NXM_OF_IP_PROTO[],load:0x1->NXM_NX_REG10[7])
 cookie=0x230473c3, duration=0.100s, table=68, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_mark=0x2/0x2,ip,reg1=0xac110106,nw_src=192.168.1.1,nw_dst=192.168.1.1 actions=load:0x1->NXM_NX_REG10[7],learn(table=69,delete_learned,cookie=0x230473c3,OXM_OF_METADATA[],eth_type=0x800,NXM_OF_IP_SRC[],ip_dst=8.8.8.7,NXM_OF_IP_PROTO[],load:0x1->NXM_NX_REG10[7])
 cookie=0x5aa27e3b, duration=0.100s, table=68, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_mark=0x2/0x2,ip,reg1=0xac110105,nw_src=192.168.1.1,nw_dst=192.168.1.1 actions=load:0x1->NXM_NX_REG10[7],learn(table=69,delete_learned,cookie=0x5aa27e3b,OXM_OF_METADATA[],eth_type=0x800,NXM_OF_IP_SRC[],ip_dst=8.8.8.7,NXM_OF_IP_PROTO[],load:0x1->NXM_NX_REG10[7])
 cookie=0x551015f5, duration=0.097s, table=68, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_mark=0x2/0x2,ip,reg1=0xac11010a,nw_src=192.168.1.1,nw_dst=192.168.1.1 actions=load:0x1->NXM_NX_REG10[7],learn(table=69,delete_learned,cookie=0x551015f5,OXM_OF_METADATA[],eth_type=0x800,NXM_OF_IP_SRC[],ip_dst=8.8.8.7,NXM_OF_IP_PROTO[],load:0x1->NXM_NX_REG10[7])
 cookie=0x6cfa83c7, duration=0.097s, table=68, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_mark=0x2/0x2,ip,reg1=0xac110109,nw_src=192.168.1.1,nw_dst=192.168.1.1 actions=load:0x1->NXM_NX_REG10[7],learn(table=69,delete_learned,cookie=0x6cfa83c7,OXM_OF_METADATA[],eth_type=0x800,NXM_OF_IP_SRC[],ip_dst=8.8.8.7,NXM_OF_IP_PROTO[],load:0x1->NXM_NX_REG10[7])
 cookie=0x540c4884, duration=0.101s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ip,reg1=0xac110101,metadata=0x3 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=8.8.8.7))
 cookie=0x47b5ab11, duration=0.101s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ip,reg1=0xac110102,metadata=0x1 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=8.8.8.7))
 cookie=0x6cfa83c7, duration=0.101s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ip,reg1=0xac110109,metadata=0x1 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=8.8.8.7))
 cookie=0x230473c3, duration=0.100s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ip,reg1=0xac110106,metadata=0x1 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=8.8.8.7))
 cookie=0xf7444fc9, duration=0.100s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ip,reg1=0xac110108,metadata=0x1 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=8.8.8.7))
 cookie=0x5aa27e3b, duration=0.100s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ip,reg1=0xac110105,metadata=0x3 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=8.8.8.7))
 cookie=0x9ddfd940, duration=0.100s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ip,reg1=0xac110107,metadata=0x3 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=8.8.8.7))
 cookie=0x6cfa83c7, duration=0.100s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ip,reg1=0xac110109,metadata=0x3 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=8.8.8.7))
 cookie=0x9f06a7ea, duration=0.099s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ip,reg1=0xac110104,metadata=0x3 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=8.8.8.7))
 cookie=0x47b5ab11, duration=0.099s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ip,reg1=0xac110102,metadata=0x3 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=8.8.8.7))
 cookie=0x9ddfd940, duration=0.098s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ip,reg1=0xac110107,metadata=0x1 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=8.8.8.7))
 cookie=0xf7444fc9, duration=0.098s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ip,reg1=0xac110108,metadata=0x3 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=8.8.8.7))
 cookie=0x551015f5, duration=0.097s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ip,reg1=0xac11010a,metadata=0x3 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=8.8.8.7))
 cookie=0xb9b025c2, duration=0.097s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ip,reg1=0xac110103,metadata=0x1 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=8.8.8.7))
 cookie=0xb9b025c2, duration=0.097s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ip,reg1=0xac110103,metadata=0x3 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=8.8.8.7))
 cookie=0x9f06a7ea, duration=0.097s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ip,reg1=0xac110104,metadata=0x1 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=8.8.8.7))
 cookie=0x540c4884, duration=0.097s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ip,reg1=0xac110101,metadata=0x1 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=8.8.8.7))
 cookie=0x230473c3, duration=0.096s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ip,reg1=0xac110106,metadata=0x3 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=8.8.8.7))
 cookie=0x5aa27e3b, duration=0.096s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ip,reg1=0xac110105,metadata=0x1 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=8.8.8.7))
 cookie=0x551015f5, duration=0.096s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ip,reg1=0xac11010a,metadata=0x1 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=8.8.8.7))
+ ovs-ofctl dump-flows br-int
+ grep 7171::8
 cookie=0x8dec9d9f, duration=0.116s, table=68, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_mark=0x2/0x2,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x7,ipv6_src=2001::1,ipv6_dst=2001::1 actions=load:0x1->NXM_NX_REG10[7],learn(table=69,delete_learned,cookie=0x8dec9d9f,OXM_OF_METADATA[],eth_type=0x86dd,NXM_NX_IPV6_SRC[],ipv6_dst=7171::8,NXM_OF_IP_PROTO[],load:0x1->NXM_NX_REG10[7])
 cookie=0x783249d4, duration=0.115s, table=68, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_mark=0x2/0x2,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x2,ipv6_src=2001::1,ipv6_dst=2001::1 actions=load:0x1->NXM_NX_REG10[7],learn(table=69,delete_learned,cookie=0x783249d4,OXM_OF_METADATA[],eth_type=0x86dd,NXM_NX_IPV6_SRC[],ipv6_dst=7171::8,NXM_OF_IP_PROTO[],load:0x1->NXM_NX_REG10[7])
 cookie=0x218d88a0, duration=0.115s, table=68, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_mark=0x2/0x2,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x10,ipv6_src=2001::1,ipv6_dst=2001::1 actions=load:0x1->NXM_NX_REG10[7],learn(table=69,delete_learned,cookie=0x218d88a0,OXM_OF_METADATA[],eth_type=0x86dd,NXM_NX_IPV6_SRC[],ipv6_dst=7171::8,NXM_OF_IP_PROTO[],load:0x1->NXM_NX_REG10[7])
 cookie=0xff484d43, duration=0.114s, table=68, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_mark=0x2/0x2,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x5,ipv6_src=2001::1,ipv6_dst=2001::1 actions=load:0x1->NXM_NX_REG10[7],learn(table=69,delete_learned,cookie=0xff484d43,OXM_OF_METADATA[],eth_type=0x86dd,NXM_NX_IPV6_SRC[],ipv6_dst=7171::8,NXM_OF_IP_PROTO[],load:0x1->NXM_NX_REG10[7])
 cookie=0xbda05351, duration=0.112s, table=68, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_mark=0x2/0x2,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x1,ipv6_src=2001::1,ipv6_dst=2001::1 actions=load:0x1->NXM_NX_REG10[7],learn(table=69,delete_learned,cookie=0xbda05351,OXM_OF_METADATA[],eth_type=0x86dd,NXM_NX_IPV6_SRC[],ipv6_dst=7171::8,NXM_OF_IP_PROTO[],load:0x1->NXM_NX_REG10[7])
 cookie=0xd609f1cf, duration=0.112s, table=68, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_mark=0x2/0x2,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x8,ipv6_src=2001::1,ipv6_dst=2001::1 actions=load:0x1->NXM_NX_REG10[7],learn(table=69,delete_learned,cookie=0xd609f1cf,OXM_OF_METADATA[],eth_type=0x86dd,NXM_NX_IPV6_SRC[],ipv6_dst=7171::8,NXM_OF_IP_PROTO[],load:0x1->NXM_NX_REG10[7])
 cookie=0xfba1dd55, duration=0.112s, table=68, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_mark=0x2/0x2,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x6,ipv6_src=2001::1,ipv6_dst=2001::1 actions=load:0x1->NXM_NX_REG10[7],learn(table=69,delete_learned,cookie=0xfba1dd55,OXM_OF_METADATA[],eth_type=0x86dd,NXM_NX_IPV6_SRC[],ipv6_dst=7171::8,NXM_OF_IP_PROTO[],load:0x1->NXM_NX_REG10[7])
 cookie=0x8ff1a1c2, duration=0.112s, table=68, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_mark=0x2/0x2,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x3,ipv6_src=2001::1,ipv6_dst=2001::1 actions=load:0x1->NXM_NX_REG10[7],learn(table=69,delete_learned,cookie=0x8ff1a1c2,OXM_OF_METADATA[],eth_type=0x86dd,NXM_NX_IPV6_SRC[],ipv6_dst=7171::8,NXM_OF_IP_PROTO[],load:0x1->NXM_NX_REG10[7])
 cookie=0xf1005978, duration=0.111s, table=68, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_mark=0x2/0x2,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x4,ipv6_src=2001::1,ipv6_dst=2001::1 actions=load:0x1->NXM_NX_REG10[7],learn(table=69,delete_learned,cookie=0xf1005978,OXM_OF_METADATA[],eth_type=0x86dd,NXM_NX_IPV6_SRC[],ipv6_dst=7171::8,NXM_OF_IP_PROTO[],load:0x1->NXM_NX_REG10[7])
 cookie=0x873fd8bf, duration=0.111s, table=68, n_packets=0, n_bytes=0, idle_age=0, priority=100,ct_mark=0x2/0x2,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x9,ipv6_src=2001::1,ipv6_dst=2001::1 actions=load:0x1->NXM_NX_REG10[7],learn(table=69,delete_learned,cookie=0x873fd8bf,OXM_OF_METADATA[],eth_type=0x86dd,NXM_NX_IPV6_SRC[],ipv6_dst=7171::8,NXM_OF_IP_PROTO[],load:0x1->NXM_NX_REG10[7])
 cookie=0x8dec9d9f, duration=0.116s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x7,metadata=0x1 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=7171::8))
 cookie=0xfba1dd55, duration=0.115s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x6,metadata=0x3 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=7171::8))
 cookie=0xd609f1cf, duration=0.115s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x8,metadata=0x1 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=7171::8))
 cookie=0xff484d43, duration=0.115s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x5,metadata=0x3 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=7171::8))
 cookie=0x8ff1a1c2, duration=0.114s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x3,metadata=0x1 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=7171::8))
 cookie=0x8dec9d9f, duration=0.114s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x7,metadata=0x3 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=7171::8))
 cookie=0x783249d4, duration=0.114s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x2,metadata=0x3 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=7171::8))
 cookie=0x218d88a0, duration=0.113s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x10,metadata=0x3 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=7171::8))
 cookie=0xd609f1cf, duration=0.113s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x8,metadata=0x3 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=7171::8))
 cookie=0xff484d43, duration=0.112s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x5,metadata=0x1 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=7171::8))
 cookie=0xbda05351, duration=0.112s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x1,metadata=0x3 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=7171::8))
 cookie=0x873fd8bf, duration=0.112s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x9,metadata=0x1 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=7171::8))
 cookie=0x873fd8bf, duration=0.112s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x9,metadata=0x3 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=7171::8))
 cookie=0x218d88a0, duration=0.111s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x10,metadata=0x1 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=7171::8))
 cookie=0x8ff1a1c2, duration=0.111s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x3,metadata=0x3 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=7171::8))
 cookie=0xfba1dd55, duration=0.111s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x6,metadata=0x1 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=7171::8))
 cookie=0xf1005978, duration=0.111s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x4,metadata=0x3 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=7171::8))
 cookie=0x783249d4, duration=0.111s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x2,metadata=0x1 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=7171::8))
 cookie=0xbda05351, duration=0.111s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x1,metadata=0x1 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=7171::8))
 cookie=0xf1005978, duration=0.110s, table=70, n_packets=0, n_bytes=0, idle_age=0, priority=190,ipv6,reg4=0x1720017,reg5=0,reg6=0,reg7=0x4,metadata=0x1 actions=ct(commit,zone=NXM_NX_REG12[0..15],nat(src=7171::8))

[root@opicee-3 bz2175998]# rpm -qa | grep -E "openvswitch3.1|ovn23.03"
openvswitch3.1-3.1.0-22.el8fdp.x86_64
ovn23.03-central-23.03.0-24.el8fdp.x86_64
ovn23.03-23.03.0-24.el8fdp.x86_64
ovn23.03-host-23.03.0-24.el8fdp.x86_64

Comment 13 errata-xmlrpc 2023-07-06 20:05:24 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (ovn23.03 bug fix and enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2023:3991