The FDP team is no longer accepting new bugs in Bugzilla. Please report your issues under FDP project in Jira. Thanks.
Bug 2009323 - [OSP 16.1][neutron][ovn] Cannot access Floating IP that has different external subnet than router external gateway subnet
Summary: [OSP 16.1][neutron][ovn] Cannot access Floating IP that has different externa...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Enterprise Linux Fast Datapath
Classification: Red Hat
Component: ovn2.13
Version: FDP 21.G
Hardware: Unspecified
OS: Unspecified
urgent
urgent
Target Milestone: ---
: ---
Assignee: Mark Michelson
QA Contact: Jianlin Shi
URL:
Whiteboard:
Depends On:
Blocks: 2009311
TreeView+ depends on / blocked
 
Reported: 2021-09-30 11:17 UTC by PURANDHAR SAIRAM MANNIDI
Modified: 2023-09-15 01:36 UTC (History)
10 users (show)

Fixed In Version: ovn2.13-20.12.0-189.el8fdp ovn-2021-21.09.0-20.el8
Doc Type: No Doc Update
Doc Text:
Clone Of:
Environment:
Last Closed: 2021-12-09 15:37:40 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker FD-1582 0 None None None 2021-09-30 11:21:24 UTC
Red Hat Product Errata RHBA-2021:5060 0 None None None 2021-12-09 15:37:45 UTC

Description PURANDHAR SAIRAM MANNIDI 2021-09-30 11:17:37 UTC
Description of problem:
Centralized router FIP traffic not reaching the VM

Version-Release number of selected component (if applicable):
ovn2.13-20.12.0-161.el8fdp.x86_64.rpm

How reproducible:
Consistently 

Steps to Reproduce:
1. Create a external network with multiple subnets (Subnet A, Subnet B, Subnet C) having non overlapping CIDR
2. create router (Router1) with external network (gateway in subnet range subnet A) and internal network as private network
3. Create 3 VMs with private network and attach FIP to 3 VMs each in subnets A, B and C. Make sure SGs are setup to all icmp and ssh from external.
4. Try reaching ( icmp ) FIPs from external host.

Actual results:
- FIP with external network subnet as Subnet A is reachable
- FIPs with external network subnets as either Subnet B or Subnet C are not reachable.

Expected results:
- FIPs in subnet B and Subnet C should also be reachable from external host.

Additional info:
- Created another Router (Router-2) with external network (gateway as Subnet C) and attach private network 2
- Attach interface (private network 2) to one of the VM with subnet C 
- Disassociate FIP from the VM above attached to private network and attach FIP in subnet C  to the private network 2
- Make sure IP and default routes are set properly
- Try pinging to the FIP in subnet C and it works.
- Disassociate FIP from the VM above attached to private network 2 and associate it to interface in private network
- set up IP and routes properly
- Try pinging to the FIP in subnet C and it works.

May be related to https://bugzilla.redhat.com/show_bug.cgi?id=1929901 or a regression from it.

Comment 1 Jianlin Shi 2021-09-30 12:59:47 UTC
Does the issue exist on ovn2.13-20.12.0-173? which is the version for 21.G

Comment 6 Jianlin Shi 2021-10-06 00:50:05 UTC
sorry for late response, as I'm still on holiday.
Mark, could you help to look into the issue

Comment 12 Jianlin Shi 2021-10-11 09:41:08 UTC
the route is sending arp request for 150.239.25.119 when capture packets on the gateway chassis:

[root@orange-controller-1 ~]# tcpdump  -i bond1 -nnle -v host 150.239.25.119 or host 150.239.25.14  or host 150.239.25.51 or host 150.238.220.140 
tcpdump: listening on bond1, link-type EN10MB (Ethernet), capture size 262144 bytes
09:38:20.050297 fa:16:3e:03:5d:1f > 00:00:0c:9f:f0:01, ethertype IPv4 (0x0800), length 98: (tos 0x0, ttl 63, id 54367, offset 0, flags [DF], proto ICMP (1), length 84)      150.239.25.119 > 150.239.16.21: ICMP echo request, id 40706, seq 0, length 64
09:38:20.055619 00:00:0c:9f:f0:01 > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Ethernet (len 6), IPv4 (len 4), Request who-has 150.239.25.119 (ff:ff:ff:ff:ff:ff) tell 150.239.25.1,length 46
09:38:22.063018 00:00:0c:9f:f0:01 > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Ethernet (len 6), IPv4 (len 4), Request who-has 150.239.25.119 (ff:ff:ff:ff:ff:ff) tell 150.239.25.1,length 46
09:38:26.067080 00:00:0c:9f:f0:01 > ff:ff:ff:ff:ff:ff, ethertype ARP (0x0806), length 60: Ethernet (len 6), IPv4 (len 4), Request who-has 150.239.25.119 (ff:ff:ff:ff:ff:ff) tell 150.239.25.1,length 46

I'm still trying to check why I can't reproduce with my reproducer.

Comment 38 Jianlin Shi 2021-11-03 07:08:37 UTC
ovn reproducer:

systemctl start openvswitch                             
systemctl start ovn-northd                                       
ovn-nbctl set-connection ptcp:6641                 
ovn-sbctl set-connection ptcp:6642                                  
ovs-vsctl set open . external_ids:system-id=hv1 external_ids:ovn-remote=tcp:1.1.182.25:6642 external_ids:ovn-encap-type=geneve external_ids:ovn-encap-ip=1.1.182.25
systemctl restart ovn-controller
                                                                                                   
ovn-nbctl ls-add net1                             
ovn-nbctl lsp-add net1 net1p1        
ovn-nbctl lsp-set-addresses net1p1 "00:00:00:01:01:05 192.168.100.5"
ovn-nbctl lsp-add net1 net1p2                        
ovn-nbctl lsp-set-addresses net1p2 "00:00:00:01:01:06 192.168.100.6"   
                                                                                                      
ovn-nbctl lr-add r1                                          
ovn-nbctl lrp-add r1 r1-net1 00:00:00:01:ff:01 192.168.100.1/24                                    
ovn-nbctl lsp-add net1 net1-r1                                
ovn-nbctl lsp-set-type net1-r1 router                                        
ovn-nbctl lsp-set-addresses net1-r1 00:00:00:01:ff:01            
ovn-nbctl lsp-set-options net1-r1 router-port=r1-net1      
                                                            
ovn-nbctl ls-add net2                                                                              
ovn-nbctl lsp-add net2 net2p1               
ovn-nbctl lsp-set-addresses net2p1 "00:00:00:02:01:07 192.168.100.7"                    
                                                                                        
ovn-nbctl lr-add r2                                                                     
ovn-nbctl lrp-add r2 r2-net2 00:00:00:02:ff:01 192.168.100.1/24                                       
ovn-nbctl lsp-add net2 net2-r2                                         
ovn-nbctl lsp-set-type net2-r2 router                        
ovn-nbctl lsp-set-addresses net2-r2 00:00:00:02:ff:01                                              
ovn-nbctl lsp-set-options net2-r2 router-port=r2-net2
                                                        
ovn-nbctl ls-add net3                                                                                 
ovn-nbctl lsp-add net3 net3p1                      
ovn-nbctl lsp-set-addresses net3p1 "00:00:00:03:01:08 192.168.200.8"
                                                                                                      
ovn-nbctl lr-add r3                       
ovn-nbctl lrp-add r3 r3-net3 00:00:00:03:ff:01 192.168.200.1/24                                    
ovn-nbctl lsp-add net3 net3-r3                    
ovn-nbctl lsp-set-type net3-r3 router     
ovn-nbctl lsp-set-addresses net3-r3 00:00:00:03:ff:01            
ovn-nbctl lsp-set-options net3-r3 router-port=r3-net3
                                                                       
ovn-nbctl ls-add pub                                                                                  
ovn-nbctl lrp-add r1 r1-pub 00:00:00:11:ff:01 172.18.1.124/24
ovn-nbctl lrp-set-gateway-chassis r1-pub hv1                                                       
ovn-nbctl lsp-add pub pub-r1                                  
ovn-nbctl lsp-set-type pub-r1 router                                         
ovn-nbctl lsp-set-addresses pub-r1 router                        
ovn-nbctl lsp-set-options pub-r1 router-port=r1-pub

ovn-nbctl lrp-add r2 r2-pub 00:00:00:12:ff:01 172.18.2.110/24
ovn-nbctl lrp-set-gateway-chassis r2-pub hv1
ovn-nbctl lsp-add pub pub-r2
ovn-nbctl lsp-set-type pub-r2 router
ovn-nbctl lsp-set-addresses pub-r2 router
ovn-nbctl lsp-set-options pub-r2 router-port=r2-pub

ovn-nbctl lrp-add r3 r3-pub 00:00:00:13:ff:01 172.18.1.173/24
ovn-nbctl lrp-set-gateway-chassis r3-pub hv1
ovn-nbctl lsp-add pub pub-r3
ovn-nbctl lsp-set-type pub-r3 router
ovn-nbctl lsp-set-addresses pub-r3 router
ovn-nbctl lsp-set-options pub-r3 router-port=r3-pub


#: << FEWROUTER
r_num=4
for i in {1..5}
do
        for j in {1..99}
        do
                ovn-nbctl lr-add r$r_num
                ovn-nbctl lrp-add r$r_num r$r_num-pub 00:00:00:$i:$j:77 172.$i.$j.1/24
                ovn-nbctl lsp-add pub pub-r$r_num
                ovn-nbctl lsp-set-type pub-r$r_num router
                ovn-nbctl lsp-set-addresses pub-r$r_num router
                ovn-nbctl lsp-set-options pub-r$r_num router-port=r$r_num-pub
                let r_num++
        done    
done    
#FEWROUTER

ovn-nbctl lr-nat-add r1 dnat_and_snat 172.18.1.10 192.168.100.5 net1p1 00:00:00:11:ff:01
ovn-nbctl lr-nat-add r1 dnat_and_snat 172.18.2.10 192.168.100.6 net1p2 00:00:00:11:ff:01
ovn-nbctl lr-nat-add r2 dnat_and_snat 172.18.2.11 192.168.100.7 net2p1 00:00:00:12:ff:01
ovn-nbctl lr-nat-add r3 dnat_and_snat 172.18.2.12 192.168.200.8 net3p1 00:00:00:13:ff:01

ovn-nbctl lr-route-add r1 0.0.0.0/0 172.18.1.1 r1-pub
ovn-nbctl lr-route-add r2 0.0.0.0/0 172.18.2.1 r2-pub
ovn-nbctl lr-route-add r3 0.0.0.0/0 172.18.1.1 r3-pub
#ovn-nbctl lr-route-add r2 172.18.2.10 172.18.2.1 r2-pub
#ovn-nbctl lr-route-add r2 172.18.2.12 172.18.2.1 r2-pub

ovs-vsctl add-br br-provider
ovs-vsctl set open . external-ids:ovn-bridge-mappings=provider:br-provider

ovn-nbctl lsp-add pub ln
ovn-nbctl lsp-set-options ln network_name=provider
ovn-nbctl lsp-set-type ln localnet
ovn-nbctl lsp-set-addresses ln unknown

ovs-vsctl add-port br-provider ext1 -- set interface ext1 type=internal
ip netns add ext1
ip link set ext1 netns ext1
ip netns exec ext1 ip link set ext1 up
ip netns exec ext1 ip addr add 172.18.1.1/24 dev ext1
ip netns exec ext1 ip addr add 172.18.2.1/24 dev ext1
ip netns exec ext1 sysctl -w net.ipv4.conf.all.rp_filter=0
ip netns exec ext1 sysctl -w net.ipv4.conf.all.forwarding=1

ovs-vsctl add-port br-int net1p1 -- set interface net1p1 type=internal external_ids:iface-id=net1p1
ip netns add net1p1
ip link set net1p1 netns net1p1
ip netns exec net1p1 ip link set net1p1 address 00:00:00:01:01:05
ip netns exec net1p1 ip link set net1p1 up
ip netns exec net1p1 ip addr add 192.168.100.5/24 dev net1p1
ip netns exec net1p1 ip route add default via 192.168.100.1 dev net1p1

ovs-vsctl add-port br-int net1p2 -- set interface net1p2 type=internal external_ids:iface-id=net1p2
ip netns add net1p2
ip link set net1p2 netns net1p2
ip netns exec net1p2 ip link set net1p2 address 00:00:00:01:01:06
ip netns exec net1p2 ip link set net1p2 up
ip netns exec net1p2 ip addr add 192.168.100.6/24 dev net1p2
ip netns exec net1p2 ip route add default via 192.168.100.1 dev net1p2

ovs-vsctl add-port br-int net2p1 -- set interface net2p1 type=internal external_ids:iface-id=net2p1
ip netns add net2p1
ip link set net2p1 netns net2p1
ip netns exec net2p1 ip link set net2p1 address 00:00:00:02:01:07
ip netns exec net2p1 ip link set net2p1 up
ip netns exec net2p1 ip addr add 192.168.100.7/24 dev net2p1
ip netns exec net2p1 ip route add default via 192.168.100.1 dev net2p1

ovs-vsctl add-port br-int net3p1 -- set interface net3p1 type=internal external_ids:iface-id=net3p1
ip netns add net3p1
ip link set net3p1 netns net3p1
ip netns exec net3p1 ip link set net3p1 address 00:00:00:03:01:08
ip netns exec net3p1 ip link set net3p1 up
ip netns exec net3p1 ip addr add 192.168.200.8/24 dev net3p1
ip netns exec net3p1 ip route add default via 192.168.200.1 dev net3p1

ovn-nbctl --wait=hv sync
ip netns exec net1p1 ping 172.18.2.10 -c 1
ip netns exec net1p1 ping 172.18.2.11 -c 1
ip netns exec net1p1 ping 172.18.2.12 -c 1
ip netns exec net1p1 ping 172.18.1.10 -c 1

ip netns exec net1p2 ping 172.18.1.10 -c 1
ip netns exec net1p2 ping 172.18.2.11 -c 1
ip netns exec net1p2 ping 172.18.2.12 -c 1
ip netns exec net1p2 ping 172.18.2.10 -c 1

ip netns exec net2p1 ping 172.18.1.10 -c 1
ip netns exec net2p1 ping 172.18.2.10 -c 1
ip netns exec net2p1 ping 172.18.2.12 -c 1
ip netns exec net2p1 ping 172.18.2.11 -c 1

ip netns exec net3p1 ping 172.18.1.10 -c 1
ip netns exec net3p1 ping 172.18.2.10 -c 1
ip netns exec net3p1 ping 172.18.2.11 -c 1
ip netns exec net3p1 ping 172.18.2.12 -c 1

ip netns exec ext1 ping 172.18.1.10 -c 1
ip netns exec ext1 ping 172.18.2.10 -c 1
ip netns exec ext1 ping 172.18.2.11 -c 1
ip netns exec ext1 ping 172.18.2.12 -c 1


reproduced on ovn-2021-21.09.0-12.el8:

[root@wsfd-advnetlab18 bz2009323]# rpm -qa | grep -E "openvswitch2.15|ovn-2021"
ovn-2021-central-21.09.0-12.el8fdp.x86_64
ovn-2021-21.09.0-12.el8fdp.x86_64
ovn-2021-host-21.09.0-12.el8fdp.x86_64
openvswitch2.15-2.15.0-26.el8fdp.x86_64

+ ovn-nbctl --wait=hv sync                                    
+ ip netns exec net1p1 ping 172.18.2.10 -c 1             
PING 172.18.2.10 (172.18.2.10) 56(84) bytes of data.                                                 
64 bytes from 172.18.2.10: icmp_seq=1 ttl=62 time=24.10 ms               
                                                           
--- 172.18.2.10 ping statistics ---                                
1 packets transmitted, 1 received, 0% packet loss, time 0ms  
rtt min/avg/max/mdev = 24.977/24.977/24.977/0.000 ms          
+ ip netns exec net1p1 ping 172.18.2.11 -c 1                            
PING 172.18.2.11 (172.18.2.11) 56(84) bytes of data.                                                 
64 bytes from 172.18.2.11: icmp_seq=1 ttl=61 time=22.4 ms    
                                            
--- 172.18.2.11 ping statistics ---                                
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 22.378/22.378/22.378/0.000 ms          
+ ip netns exec net1p1 ping 172.18.2.12 -c 1                            
PING 172.18.2.12 (172.18.2.12) 56(84) bytes of data.                                                 
64 bytes from 172.18.2.12: icmp_seq=1 ttl=62 time=38.2 ms
                                            
--- 172.18.2.12 ping statistics ---                                
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 38.184/38.184/38.184/0.000 ms          
+ ip netns exec net1p1 ping 172.18.1.10 -c 1                            
PING 172.18.1.10 (172.18.1.10) 56(84) bytes of data.                                                 
64 bytes from 172.18.1.10: icmp_seq=1 ttl=62 time=1.95 ms
                                            
--- 172.18.1.10 ping statistics ---                                
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.949/1.949/1.949/0.000 ms             
+ ip netns exec net1p2 ping 172.18.1.10 -c 1                            
PING 172.18.1.10 (172.18.1.10) 56(84) bytes of data.       
64 bytes from 172.18.1.10: icmp_seq=1 ttl=62 time=1.70 ms
                                                    
--- 172.18.1.10 ping statistics ---                                     
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.698/1.698/1.698/0.000 ms
+ ip netns exec net1p2 ping 172.18.2.11 -c 1                 
PING 172.18.2.11 (172.18.2.11) 56(84) bytes of data.
                                            
--- 172.18.2.11 ping statistics ---                          
1 packets transmitted, 0 received, 100% packet loss, time 0ms
                                            
+ ip netns exec net1p2 ping 172.18.2.12 -c 1                 
PING 172.18.2.12 (172.18.2.12) 56(84) bytes of data.       
                                                    
--- 172.18.2.12 ping statistics ---                 
1 packets transmitted, 0 received, 100% packet loss, time 0ms

<==== FAIL

+ ip netns exec net1p2 ping 172.18.2.10 -c 1
PING 172.18.2.10 (172.18.2.10) 56(84) bytes of data.
64 bytes from 172.18.2.10: icmp_seq=1 ttl=62 time=1.95 ms

--- 172.18.2.10 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.950/1.950/1.950/0.000 ms

+ ip netns exec net2p1 ping 172.18.1.10 -c 1
PING 172.18.1.10 (172.18.1.10) 56(84) bytes of data.
64 bytes from 172.18.1.10: icmp_seq=1 ttl=61 time=3.37 ms

--- 172.18.1.10 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 3.365/3.365/3.365/0.000 ms
+ ip netns exec net2p1 ping 172.18.2.10 -c 1
PING 172.18.2.10 (172.18.2.10) 56(84) bytes of data.

--- 172.18.2.10 ping statistics ---
1 packets transmitted, 0 received, 100% packet loss, time 0ms

+ ip netns exec net2p1 ping 172.18.2.12 -c 1
PING 172.18.2.12 (172.18.2.12) 56(84) bytes of data.

--- 172.18.2.12 ping statistics ---
1 packets transmitted, 0 received, 100% packet loss, time 0ms

+ ip netns exec net2p1 ping 172.18.2.11 -c 1
PING 172.18.2.11 (172.18.2.11) 56(84) bytes of data.
64 bytes from 172.18.2.11: icmp_seq=1 ttl=62 time=2.33 ms

--- 172.18.2.11 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 2.332/2.332/2.332/0.000 ms
+ ip netns exec net3p1 ping 172.18.1.10 -c 1
PING 172.18.1.10 (172.18.1.10) 56(84) bytes of data.
64 bytes from 172.18.1.10: icmp_seq=1 ttl=61 time=3.09 ms

--- 172.18.1.10 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 3.087/3.087/3.087/0.000 ms
+ ip netns exec net3p1 ping 172.18.2.10 -c 1
PING 172.18.2.10 (172.18.2.10) 56(84) bytes of data.
From 172.18.2.1 icmp_seq=1 Destination Host Unreachable

--- 172.18.2.10 ping statistics ---
1 packets transmitted, 0 received, +1 errors, 100% packet loss, time 0ms

+ ip netns exec net3p1 ping 172.18.2.11 -c 1
PING 172.18.2.11 (172.18.2.11) 56(84) bytes of data.

--- 172.18.2.11 ping statistics ---
1 packets transmitted, 0 received, 100% packet loss, time 0ms

+ ip netns exec net3p1 ping 172.18.2.12 -c 1
PING 172.18.2.12 (172.18.2.12) 56(84) bytes of data.
64 bytes from 172.18.2.12: icmp_seq=1 ttl=62 time=2.12 ms

--- 172.18.2.12 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 2.121/2.121/2.121/0.000 ms

+ ip netns exec ext1 ping 172.18.1.10 -c 1
PING 172.18.1.10 (172.18.1.10) 56(84) bytes of data.
64 bytes from 172.18.1.10: icmp_seq=1 ttl=63 time=1.85 ms

--- 172.18.1.10 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.846/1.846/1.846/0.000 ms
+ ip netns exec ext1 ping 172.18.2.10 -c 1
PING 172.18.2.10 (172.18.2.10) 56(84) bytes of data.

--- 172.18.2.10 ping statistics ---
1 packets transmitted, 0 received, 100% packet loss, time 0ms

+ ip netns exec ext1 ping 172.18.2.11 -c 1
PING 172.18.2.11 (172.18.2.11) 56(84) bytes of data.
64 bytes from 172.18.2.11: icmp_seq=1 ttl=63 time=1.96 ms

--- 172.18.2.11 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.964/1.964/1.964/0.000 ms
+ ip netns exec ext1 ping 172.18.2.12 -c 1
PING 172.18.2.12 (172.18.2.12) 56(84) bytes of data.
64 bytes from 172.18.2.12: icmp_seq=1 ttl=63 time=1.71 ms

--- 172.18.2.12 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.712/1.712/1.712/0.000 ms

[root@wsfd-advnetlab18 bz2009323]# grep resubmit /var/log/openvswitch/ovs-vswitchd.log
2021-11-03T06:55:31.042Z|00002|ofproto_dpif_xlate(handler2)|WARN|over 4096 resubmit actions on bridge br-int while processing arp,in_port=1,vlan_tci=0x0000,dl_src=00:00:00:13:ff:01,dl_dst=da:f3:bd:d0:f0:ea,arp_spa=172.18.2.12,arp_tpa=172.18.2.1,arp_op=2,arp_sha=00:00:00:13:ff:01,arp_tha=da:f3:bd:d0:f0:ea 
2021-11-03T06:55:31.174Z|00003|ofproto_dpif_xlate(handler2)|WARN|over 4096 resubmit actions on bridge br-int while processing arp,in_port=1,vlan_tci=0x0000,dl_src=da:f3:bd:d0:f0:ea,dl_dst=ff:ff:ff:ff:ff:ff,arp_spa=172.18.2.1,arp_tpa=172.18.2.10,arp_op=1,arp_sha=da:f3:bd:d0:f0:ea,arp_tha=00:00:00:00:00:00 
2021-11-03T06:55:31.177Z|00050|ofproto_dpif_xlate|WARN|over 4096 resubmit actions on bridge br-int while processing arp,in_port=CONTROLLER,vlan_tci=0x0000,dl_src=00:00:00:12:ff:01,dl_dst=00:00:00:00:00:00,arp_spa=192.168.100.7,arp_tpa=172.18.2.10,arp_op=1,arp_sha=00:00:00:12:ff:01,arp_tha=00:00:00:00:00:00
2021-11-03T06:55:41.950Z|00001|ofproto_dpif_xlate(handler17)|WARN|over 4096 resubmit actions on bridge br-int while processing icmp6,in_port=1,vlan_tci=0x0000,dl_src=da:f3:bd:d0:f0:ea,dl_dst=33:33:00:00:00:02,ipv6_src=fe80::d8f3:bdff:fed0:f0ea,ipv6_dst=ff02::2,ipv6_label=0x00000,nw_tos=0,nw_ecn=0,nw_ttl=255,icmp_type=133,icmp_code=0
2021-11-03T06:55:51.292Z|00052|ofproto_dpif_xlate|WARN|over 4096 resubmit actions on bridge br-int while processing arp,in_port=CONTROLLER,vlan_tci=0x0000,dl_src=00:00:00:12:ff:01,dl_dst=00:00:00:00:00:00,arp_spa=192.168.100.7,arp_tpa=172.18.2.10,arp_op=1,arp_sha=00:00:00:12:ff:01,arp_tha=00:00:00:00:00:00
2021-11-03T06:56:41.854Z|00002|ofproto_dpif_xlate(handler3)|WARN|over 4096 resubmit actions on bridge br-int while processing icmp6,in_port=1,vlan_tci=0x0000,dl_src=da:f3:bd:d0:f0:ea,dl_dst=33:33:00:00:00:02,ipv6_src=fe80::d8f3:bdff:fed0:f0ea,ipv6_dst=ff02::2,ipv6_label=0x00000,nw_tos=0,nw_ecn=0,nw_ttl=255,icmp_type=133,icmp_code=0
2021-11-03T06:58:36.559Z|00003|ofproto_dpif_xlate(handler3)|WARN|over 4096 resubmit actions on bridge br-int while processing icmp6,in_port=1,vlan_tci=0x0000,dl_src=da:f3:bd:d0:f0:ea,dl_dst=33:33:00:00:00:02,ipv6_src=fe80::d8f3:bdff:fed0:f0ea,ipv6_dst=ff02::2,ipv6_label=0x00000,nw_tos=0,nw_ecn=0,nw_ttl=255,icmp_type=133,icmp_code=0
2021-11-03T07:02:17.729Z|00004|ofproto_dpif_xlate(handler3)|WARN|over 4096 resubmit actions on bridge br-int while processing icmp6,in_port=1,vlan_tci=0x0000,dl_src=da:f3:bd:d0:f0:ea,dl_dst=33:33:00:00:00:02,ipv6_src=fe80::d8f3:bdff:fed0:f0ea,ipv6_dst=ff02::2,ipv6_label=0x00000,nw_tos=0,nw_ecn=0,nw_ttl=255,icmp_type=133,icmp_code=0


<=== resubmit in log

Comment 39 Jianlin Shi 2021-11-08 02:40:39 UTC
Verified on ovn-2021-21.09.0-20.el8:

[root@dell-per740-12 bz2009323]# rpm -qa | grep -E "openvswitch2.15|ovn-2021"
python3-openvswitch2.15-2.15.0-51.el8fdp.x86_64
ovn-2021-21.09.0-20.el8fdp.x86_64
ovn-2021-host-21.09.0-20.el8fdp.x86_64
openvswitch2.15-2.15.0-51.el8fdp.x86_64
ovn-2021-central-21.09.0-20.el8fdp.x86_64

+ ovn-nbctl --wait=hv sync                                 
+ ip netns exec net1p1 ping 172.18.2.10 -c 1             
PING 172.18.2.10 (172.18.2.10) 56(84) bytes of data.       
64 bytes from 172.18.2.10: icmp_seq=1 ttl=62 time=28.8 ms
                                                           
--- 172.18.2.10 ping statistics ---                        
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 28.830/28.830/28.830/0.000 ms       
+ ip netns exec net1p1 ping 172.18.2.11 -c 1             
PING 172.18.2.11 (172.18.2.11) 56(84) bytes of data.       
64 bytes from 172.18.2.11: icmp_seq=1 ttl=61 time=22.4 ms
                                                           
--- 172.18.2.11 ping statistics ---                        
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 22.402/22.402/22.402/0.000 ms       
+ ip netns exec net1p1 ping 172.18.2.12 -c 1             
PING 172.18.2.12 (172.18.2.12) 56(84) bytes of data.       
64 bytes from 172.18.2.12: icmp_seq=1 ttl=62 time=17.1 ms
                                                           
--- 172.18.2.12 ping statistics ---                        
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 17.148/17.148/17.148/0.000 ms                                
+ ip netns exec net1p1 ping 172.18.1.10 -c 1                                 
PING 172.18.1.10 (172.18.1.10) 56(84) bytes of data.       
64 bytes from 172.18.1.10: icmp_seq=1 ttl=62 time=2.25 ms
                                                           
--- 172.18.1.10 ping statistics ---                 
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 2.247/2.247/2.247/0.000 ms          
+ ip netns exec net1p2 ping 172.18.1.10 -c 1
PING 172.18.1.10 (172.18.1.10) 56(84) bytes of data.
64 bytes from 172.18.1.10: icmp_seq=1 ttl=62 time=1.70 ms

--- 172.18.1.10 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.703/1.703/1.703/0.000 ms
+ ip netns exec net1p2 ping 172.18.2.11 -c 1
PING 172.18.2.11 (172.18.2.11) 56(84) bytes of data.
64 bytes from 172.18.2.11: icmp_seq=1 ttl=62 time=10.7 ms

--- 172.18.2.11 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 10.714/10.714/10.714/0.000 ms
+ ip netns exec net1p2 ping 172.18.2.12 -c 1
PING 172.18.2.12 (172.18.2.12) 56(84) bytes of data.
64 bytes from 172.18.2.12: icmp_seq=1 ttl=61 time=9.57 ms

--- 172.18.2.12 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 9.571/9.571/9.571/0.000 ms
+ ip netns exec net1p2 ping 172.18.2.10 -c 1
PING 172.18.2.10 (172.18.2.10) 56(84) bytes of data.
64 bytes from 172.18.2.10: icmp_seq=1 ttl=62 time=2.02 ms

--- 172.18.2.10 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 2.017/2.017/2.017/0.000 ms
+ ip netns exec net2p1 ping 172.18.1.10 -c 1
PING 172.18.1.10 (172.18.1.10) 56(84) bytes of data.
64 bytes from 172.18.1.10: icmp_seq=1 ttl=61 time=1.96 ms

--- 172.18.1.10 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.959/1.959/1.959/0.000 ms
+ ip netns exec net2p1 ping 172.18.2.10 -c 1
PING 172.18.2.10 (172.18.2.10) 56(84) bytes of data.
64 bytes from 172.18.2.10: icmp_seq=1 ttl=61 time=1.46 ms

--- 172.18.2.10 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.457/1.457/1.457/0.000 ms
+ ip netns exec net2p1 ping 172.18.2.12 -c 1
PING 172.18.2.12 (172.18.2.12) 56(84) bytes of data.
64 bytes from 172.18.2.12: icmp_seq=1 ttl=61 time=13.9 ms

--- 172.18.2.12 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 13.866/13.866/13.866/0.000 ms
+ ip netns exec net2p1 ping 172.18.2.11 -c 1
PING 172.18.2.11 (172.18.2.11) 56(84) bytes of data.
64 bytes from 172.18.2.11: icmp_seq=1 ttl=62 time=2.01 ms

--- 172.18.2.11 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 2.007/2.007/2.007/0.000 ms
+ ip netns exec net3p1 ping 172.18.1.10 -c 1
PING 172.18.1.10 (172.18.1.10) 56(84) bytes of data.
64 bytes from 172.18.1.10: icmp_seq=1 ttl=61 time=1.88 ms

--- 172.18.1.10 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.878/1.878/1.878/0.000 ms
+ ip netns exec net3p1 ping 172.18.2.10 -c 1
PING 172.18.2.10 (172.18.2.10) 56(84) bytes of data.
64 bytes from 172.18.2.10: icmp_seq=1 ttl=61 time=1.30 ms

--- 172.18.2.10 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.295/1.295/1.295/0.000 ms
+ ip netns exec net3p1 ping 172.18.2.11 -c 1
PING 172.18.2.11 (172.18.2.11) 56(84) bytes of data.
64 bytes from 172.18.2.11: icmp_seq=1 ttl=62 time=1.23 ms

--- 172.18.2.11 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.234/1.234/1.234/0.000 ms
+ ip netns exec net3p1 ping 172.18.2.12 -c 1
PING 172.18.2.12 (172.18.2.12) 56(84) bytes of data.
64 bytes from 172.18.2.12: icmp_seq=1 ttl=62 time=1.91 ms

--- 172.18.2.12 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.905/1.905/1.905/0.000 ms
+ ip netns exec ext1 ping 172.18.1.10 -c 1
PING 172.18.1.10 (172.18.1.10) 56(84) bytes of data.
64 bytes from 172.18.1.10: icmp_seq=1 ttl=63 time=1.10 ms

--- 172.18.1.10 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.097/1.097/1.097/0.000 ms
+ ip netns exec ext1 ping 172.18.2.10 -c 1
PING 172.18.2.10 (172.18.2.10) 56(84) bytes of data.
64 bytes from 172.18.2.10: icmp_seq=1 ttl=63 time=1.07 ms

--- 172.18.2.10 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.070/1.070/1.070/0.000 ms
+ ip netns exec ext1 ping 172.18.2.11 -c 1
PING 172.18.2.11 (172.18.2.11) 56(84) bytes of data.
64 bytes from 172.18.2.11: icmp_seq=1 ttl=63 time=1.01 ms

--- 172.18.2.11 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.010/1.010/1.010/0.000 ms
+ ip netns exec ext1 ping 172.18.2.12 -c 1
PING 172.18.2.12 (172.18.2.12) 56(84) bytes of data.
64 bytes from 172.18.2.12: icmp_seq=1 ttl=63 time=1.05 ms

--- 172.18.2.12 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.054/1.054/1.054/0.000 ms

[root@dell-per740-12 bz2009323]# grep resubmit /var/log/openvswitch/ovs-vswitchd.log

Comment 40 Jianlin Shi 2021-11-08 02:53:30 UTC
with the reproducer, reproduced on ovn2.13-20.12.0-178.el8:

[root@dell-per740-12 bz2009323]# rpm -qa | grep -E "openvswitch2.15|ovn2.13"
ovn2.13-20.12.0-178.el8fdp.x86_64
python3-openvswitch2.15-2.15.0-51.el8fdp.x86_64
ovn2.13-central-20.12.0-178.el8fdp.x86_64
openvswitch2.15-2.15.0-51.el8fdp.x86_64
ovn2.13-host-20.12.0-178.el8fdp.x86_64

...
+ ip netns exec net1p2 ping 172.18.2.11 -c 1
PING 172.18.2.11 (172.18.2.11) 56(84) bytes of data.         
                                                           
--- 172.18.2.11 ping statistics ---              
1 packets transmitted, 0 received, 100% packet loss, time 0ms
                                                     
+ ip netns exec net1p2 ping 172.18.2.12 -c 1
PING 172.18.2.12 (172.18.2.12) 56(84) bytes of data.         
From 172.18.2.1 icmp_seq=1 Destination Host Unreachable      
                                            
--- 172.18.2.12 ping statistics ---                                                 
1 packets transmitted, 0 received, +1 errors, 100% packet loss, time 0ms                                                                                                                                    
                                                                                                     
+ ip netns exec net1p2 ping 172.18.2.10 -c 1                                                                                                                                                                
PING 172.18.2.10 (172.18.2.10) 56(84) bytes of data.                                                                                                                                                       
64 bytes from 172.18.2.10: icmp_seq=1 ttl=62 time=1.70 ms                                                                                                                                                   
                                                                                                     
--- 172.18.2.10 ping statistics ---                                                                                                                                                                         
1 packets transmitted, 1 received, 0% packet loss, time 0ms                                          
rtt min/avg/max/mdev = 1.701/1.701/1.701/0.000 ms
....


[root@dell-per740-12 bz2009323]# grep resubmit /var/log/openvswitch/ovs-vswitchd.log
2021-11-08T02:44:43.828Z|00001|ofproto_dpif_xlate(handler2)|WARN|over 4096 resubmit actions on bridge br-int while processing arp,in_port=1,vlan_tci=0x0000,dl_src=06:5c:e2:41:1e:08,dl_dst=ff:ff:ff:ff:ff:ff,arp_spa=172.18.2.1,arp_tpa=172.18.2.12,arp_op=1,arp_sha=06:5c:e2:41:1e:08,arp_tha=00:00:00:00:00:00
2021-11-08T02:44:45.945Z|00001|ofproto_dpif_xlate(handler1)|WARN|over 4096 resubmit actions on bridge br-int while processing icmp6,in_port=1,vlan_tci=0x0000,dl_src=06:5c:e2:41:1e:08,dl_dst=33:33:00:00:00:02,ipv6_src=fe80::45c:e2ff:fe41:1e08,ipv6_dst=ff02::2,ipv6_label=0x00000,nw_tos=0,nw_ecn=0,nw_ttl=255,icmp_type=133,icmp_code=0
2021-11-08T02:44:47.009Z|00002|ofproto_dpif_xlate(handler1)|WARN|over 4096 resubmit actions on bridge br-int while processing arp,in_port=1,vlan_tci=0x0000,dl_src=00:00:00:11:ff:01,dl_dst=06:5c:e2:41:1e:08,arp_spa=172.18.2.10,arp_tpa=172.18.2.1,arp_op=2,arp_sha=00:00:00:11:ff:01,arp_tha=06:5c:e2:41:1e:08
2021-11-08T02:44:47.012Z|00051|ofproto_dpif_xlate|WARN|over 4096 resubmit actions on bridge br-int while processing arp,in_port=CONTROLLER,vlan_tci=0x0000,dl_src=00:00:00:11:ff:01,dl_dst=00:00:00:12:ff:01,arp_spa=172.18.2.10,arp_tpa=172.18.2.11,arp_op=2,arp_sha=00:00:00:11:ff:01,arp_tha=00:00:00:12:ff:01
2021-11-08T02:44:57.036Z|00003|ofproto_dpif_xlate(handler1)|WARN|over 4096 resubmit actions on bridge br-int while processing arp,in_port=1,vlan_tci=0x0000,dl_src=06:5c:e2:41:1e:08,dl_dst=ff:ff:ff:ff:ff:ff,arp_spa=172.18.2.1,arp_tpa=172.18.2.12,arp_op=1,arp_sha=06:5c:e2:41:1e:08,arp_tha=00:00:00:00:00:00


Verified on ovn2.13-20.12.0-189.el8:

[root@dell-per740-12 bz2009323]# rpm -qa | grep -E "openvswitch2.15|ovn2.13"
ovn2.13-central-20.12.0-189.el8fdp.x86_64                                                             
python3-openvswitch2.15-2.15.0-51.el8fdp.x86_64                                                       
ovn2.13-20.12.0-189.el8fdp.x86_64                                                                     
ovn2.13-host-20.12.0-189.el8fdp.x86_64                                                                
openvswitch2.15-2.15.0-51.el8fdp.x86_64

[root@dell-per740-12 bz2009323]# grep resubmit /var/log/openvswitch/ovs-vswitchd.log

Comment 43 Jianlin Shi 2021-11-09 01:05:06 UTC
set VERIFIED per comment 39 and comment 40

Comment 45 errata-xmlrpc 2021-12-09 15:37:40 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (ovn2.13 bug fix and enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:5060

Comment 46 Red Hat Bugzilla 2023-09-15 01:36:21 UTC
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 365 days


Note You need to log in before you can comment on or make changes to this bug.