Bug 2025623

Summary: OSP17 instance can't reach router's interface when it's spawned before network was plugged to the router
Product: Red Hat Enterprise Linux Fast Datapath Reporter: Slawek Kaplonski <skaplons>
Component: ovn-2021Assignee: lorenzo bianconi <lorenzo.bianconi>
Status: CLOSED ERRATA QA Contact: Jianlin Shi <jishi>
Severity: urgent Docs Contact:
Priority: urgent    
Version: FDP 21.ICC: apevec, bcafarel, bdobreli, chrisw, ctrautma, dalvarez, dceara, eelahi, ekuris, jiji, jlibosva, kfida, lorenzo.bianconi, mmichels, rhos-maint, rlandy, sandyada, scohen, skaplons
Target Milestone: ---   
Target Release: FDP 22.A   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: ovn-2021-21.09.1-24.el8fdp ovn21.09-21.09.0-23.el8fdp Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: 2024898 Environment:
Last Closed: 2022-02-24 17:47:39 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 2024898    

Comment 16 Dumitru Ceara 2022-01-06 10:49:14 UTC
*** Bug 2037507 has been marked as a duplicate of this bug. ***

Comment 20 Jianlin Shi 2022-01-18 06:41:47 UTC
tested with following script:

systemctl start openvswitch                                              
systemctl start ovn-northd
ovn-nbctl set-connection ptcp:6641                                                              
ovn-sbctl set-connection ptcp:6642
ovs-vsctl set open . external_ids:system-id=hv1 external_ids:ovn-remote=tcp:1.1.184.25:6642 external_ids:ovn-encap-type=geneve external_ids:ovn-encap-ip=1.1.184.25
systemctl restart ovn-controller                               
                                        
                                                        
ovn-nbctl --wait=hv sync                            
                                                                    
ovn-nbctl ls-add ls1                                             
ovn-nbctl lsp-add ls1 ls1-lr1
ovn-nbctl lsp-set-addresses ls1-lr1 "00:00:00:00:00:01 192.168.1.254 2001::a"                   
ovn-nbctl lsp-set-type ls1-lr1 router
ovn-nbctl lsp-set-options ls1-lr1 router-port=lr1-ls1
                                                               
ovn-nbctl lsp-add ls1 ls1p1             
ovn-nbctl lsp-set-addresses ls1p1 "00:00:00:01:01:01 192.168.1.1 2001::1"
ovn-nbctl lsp-add ls1 ls1p2                         
ovn-nbctl lsp-set-addresses ls1p2 "00:00:00:01:01:02 192.168.1.2 2001::2"
                                                                 
ovn-nbctl ls-add ls2
ovn-nbctl lsp-add ls2 ls2-lr1
ovn-nbctl lsp-set-addresses ls2-lr1 "00:00:00:00:00:02 192.168.2.254 2002::a"
ovn-nbctl lsp-set-type ls2-lr1 router
ovn-nbctl lsp-set-options ls2-lr1 router-port=lr1-ls2                      
                                                                           
ovn-nbctl lsp-add ls2 ls2p1
ovn-nbctl lsp-set-addresses ls2p1 "00:00:00:01:02:01 192.168.2.1 2002::1"
ovn-nbctl lsp-add ls2 ls2p2                          
ovn-nbctl lsp-set-addresses ls2p2 "00:00:00:01:02:02 192.168.2.2 2002::2"
                                  
ovs-vsctl add-port br-int ls1p1 -- set interface ls1p1 type=internal external_ids:iface-id=ls1p1
ip netns add ls1p1 
ip link set ls1p1 netns ls1p1
ip netns exec ls1p1 ip link set ls1p1 address 00:00:00:01:01:01
ip netns exec ls1p1 ip link set ls1p1 up
ip netns exec ls1p1 ip addr add 192.168.1.1/24 dev ls1p1
ip netns exec ls1p1 ip addr add 2001::1/64 dev ls1p1
ip netns exec ls1p1 ip route add default via 192.168.1.254 dev ls1p1
ip netns exec ls1p1 ip -6 route add default via 2001::a dev ls1p1

ovs-vsctl add-port br-int ls2p1 -- set interface ls2p1 type=internal external_ids:iface-id=ls2p1
ip netns add ls2p1 
ip link set ls2p1 netns ls2p1
ip netns exec ls2p1 ip link set ls2p1 address 00:00:00:01:02:01
ip netns exec ls2p1 ip link set ls2p1 up
ip netns exec ls2p1 ip addr add 192.168.2.1/24 dev ls2p1
ip netns exec ls2p1 ip addr add 2002::1/64 dev ls2p1
ip netns exec ls2p1 ip route add default via 192.168.2.254 dev ls2p1
ip netns exec ls2p1 ip -6 route add default via 2002::a dev ls2p1

ovn-nbctl --wait=hv sync

ovn-nbctl lr-add lr1
ovn-nbctl lrp-add lr1 lr1-ls1 00:00:00:00:00:01 192.168.1.254/24 2001::a/64
ovn-nbctl lrp-add lr1 lr1-ls2 00:00:00:00:00:02 192.168.2.254/24 2002::a/64

ovn-nbctl --wait=hv sync
ip netns exec ls1p1 ping 192.168.1.254 -c 1 -w 1 -W 1
ip netns exec ls1p1 ping 192.168.2.1 -c 1 -w 1 -W 1
ip netns exec ls2p1 ping 192.168.2.254 -c 1 -w 1 -W 1

reproduced on ovn-2021-21.09.1-23:

+ ip netns exec ls1p1 ping 192.168.1.254 -c 1 -w 1 -W 1
PING 192.168.1.254 (192.168.1.254) 56(84) bytes of data.
64 bytes from 192.168.1.254: icmp_seq=1 ttl=254 time=1.03 ms

--- 192.168.1.254 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.030/1.030/1.030/0.000 ms
+ ip netns exec ls1p1 ping 192.168.2.1 -c 1 -w 1 -W 1
PING 192.168.2.1 (192.168.2.1) 56(84) bytes of data.

--- 192.168.2.1 ping statistics ---
1 packets transmitted, 0 received, 100% packet loss, time 0ms

+ ip netns exec ls2p1 ping 192.168.2.254 -c 1 -w 1 -W 1
PING 192.168.2.254 (192.168.2.254) 56(84) bytes of data.

--- 192.168.2.254 ping statistics ---
1 packets transmitted, 0 received, 100% packet loss, time 0ms

<=== fail to ping router port

[root@wsfd-advnetlab16 bz2025623]# rpm -qa | grep -E "openvswitch2.16|ovn-2021"
openvswitch2.16-2.16.0-35.el8fdp.x86_64
ovn-2021-host-21.09.1-23.el8fdp.x86_64
python3-openvswitch2.16-2.16.0-35.el8fdp.x86_64
ovn-2021-central-21.09.1-23.el8fdp.x86_64
ovn-2021-21.09.1-23.el8fdp.x86_64

Verified on ovn-2021-21.09.1-24:

+ ip netns exec ls1p1 ping 192.168.1.254 -c 1 -w 1 -W 1
PING 192.168.1.254 (192.168.1.254) 56(84) bytes of data.
64 bytes from 192.168.1.254: icmp_seq=1 ttl=254 time=1.03 ms
                                                                                                      
--- 192.168.1.254 ping statistics ---                                                                 
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.032/1.032/1.032/0.000 ms                                                     
+ ip netns exec ls1p1 ping 192.168.2.1 -c 1 -w 1 -W 1
PING 192.168.2.1 (192.168.2.1) 56(84) bytes of data.
64 bytes from 192.168.2.1: icmp_seq=1 ttl=63 time=1.49 ms
                                                                                                      
--- 192.168.2.1 ping statistics ---                                                                   
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.493/1.493/1.493/0.000 ms                                                     
+ ip netns exec ls2p1 ping 192.168.2.254 -c 1 -w 1 -W 1
PING 192.168.2.254 (192.168.2.254) 56(84) bytes of data.
64 bytes from 192.168.2.254: icmp_seq=1 ttl=254 time=0.598 ms
                                                                                                      
--- 192.168.2.254 ping statistics ---                                                                 
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.598/0.598/0.598/0.000 ms    

<=== ping passed
                                                 
[root@wsfd-advnetlab16 bz2025623]# rpm -qa | grep -E "openvswitch2.16|ovn-2021"
openvswitch2.16-2.16.0-35.el8fdp.x86_64                                                               
python3-openvswitch2.16-2.16.0-35.el8fdp.x86_64                                                       
ovn-2021-21.09.1-24.el8fdp.x86_64                                                                     
ovn-2021-host-21.09.1-24.el8fdp.x86_64                                                                
ovn-2021-central-21.09.1-24.el8fdp.x86_64

Comment 21 Jianlin Shi 2022-01-18 06:53:00 UTC
also verified on ovn-2021-21.12.0-11:

+ ip netns exec ls1p1 ping 192.168.1.254 -c 1 -w 1 -W 1
PING 192.168.1.254 (192.168.1.254) 56(84) bytes of data.
64 bytes from 192.168.1.254: icmp_seq=1 ttl=254 time=0.986 ms
                                                                                                      
--- 192.168.1.254 ping statistics ---                                                                 
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.986/0.986/0.986/0.000 ms                                                     
+ ip netns exec ls1p1 ping 192.168.2.1 -c 1 -w 1 -W 1
PING 192.168.2.1 (192.168.2.1) 56(84) bytes of data.
64 bytes from 192.168.2.1: icmp_seq=1 ttl=63 time=1.33 ms
                                                                                                      
--- 192.168.2.1 ping statistics ---                                                                   
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 1.332/1.332/1.332/0.000 ms                                                     
+ ip netns exec ls2p1 ping 192.168.2.254 -c 1 -w 1 -W 1
PING 192.168.2.254 (192.168.2.254) 56(84) bytes of data.
64 bytes from 192.168.2.254: icmp_seq=1 ttl=254 time=0.528 ms
                                                                                                      
--- 192.168.2.254 ping statistics ---                                                                 
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.528/0.528/0.528/0.000 ms                                                     
[root@wsfd-advnetlab16 bz2025623]# rpm -qa | grep -E "openvswitch2.16|ovn-2021"
openvswitch2.16-2.16.0-35.el8fdp.x86_64                                                               
ovn-2021-21.12.0-11.el8fdp.x86_64                                                                     
python3-openvswitch2.16-2.16.0-35.el8fdp.x86_64                                                       
ovn-2021-central-21.12.0-11.el8fdp.x86_64                                                             
ovn-2021-host-21.12.0-11.el8fdp.x86_64

Comment 24 errata-xmlrpc 2022-02-24 17:47:39 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (ovn bug fix and enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2022:0674

Comment 25 Sandeep Yadav 2022-05-19 05:05:56 UTC
*** Bug 2024898 has been marked as a duplicate of this bug. ***