Bug 2147498

Summary: After a minor update, connectiviy issues between a new instance and metadata.
Product: Red Hat Enterprise Linux Fast Datapath Reporter: OVN Bot <ovn-bot>
Component: ovn22.03Assignee: xsimonar
Status: CLOSED ERRATA QA Contact: Ehsan Elahi <eelahi>
Severity: high Docs Contact:
Priority: high    
Version: FDP 21.FCC: apevec, bcafarel, ctrautma, dhill, egarciar, ekuris, jiji, jishi, jmarcian, lhh, lmiccini, majopela, mmichels, mtomaska, rhos-maint, scohen, skaplons, xsimonar, ykarel
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: ovn22.03-22.03.0-123.el8fdp Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2022-12-15 15:26:33 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description OVN Bot 2022-11-24 05:03:56 UTC
This is an automatically-generated clone of issue https://bugzilla.redhat.com/show_bug.cgi?id=2129866

Comment 3 Ehsan Elahi 2022-12-05 20:31:45 UTC
Using the reproducer mentioned in https://bugzilla.redhat.com/show_bug.cgi?id=2129866#c1

Reproduced on:
[root@@bz-2129866 ~]# rpm -qa |grep -E 'ovn|openvswitch'
ovn22.03-22.03.0-106.el8fdp.x86_64
ovn22.03-central-22.03.0-106.el8fdp.x86_64
openvswitch-selinux-extra-policy-1.0-29.el8fdp.noarch
ovn22.03-host-22.03.0-106.el8fdp.x86_64
openvswitch2.17-2.17.0-57.el8fdp.x86_64

========= After running create.sh ===========
[root@@bz-2129866 ~]# ovn-sbctl find port_binding logical_port=ls1lp|grep uuid|cut -d: -f2| cut -c1-9
 e2466ff3
[root@@bz-2129866 ~]# COOKIE=$(ovn-sbctl find port_binding logical_port=ls1lp|grep uuid|cut -d: -f2| cut -c1-9)
[root@@bz-2129866 ~]# ovs-ofctl dump-flows br-int|grep $COOKIE
 cookie=0xe2466ff3, duration=40.898s, table=0, n_packets=2, n_bytes=140, idle_age=25, priority=100,in_port=2 actions=load:0x3->NXM_NX_REG13[],load:0x4->NXM_NX_REG11[],load:0x1->NXM_NX_REG12[],load:0x1->OXM_OF_METADATA[],load:0x2->NXM_NX_REG14[],load:0x1->NXM_NX_REG10[10],resubmit(,8)
 cookie=0xe2466ff3, duration=40.898s, table=37, n_packets=2, n_bytes=140, idle_age=25, priority=150,reg14=0x2,metadata=0x1 actions=resubmit(,38)
 cookie=0xe2466ff3, duration=40.898s, table=38, n_packets=0, n_bytes=0, idle_age=40, priority=100,reg15=0x2,metadata=0x1 actions=load:0x3->NXM_NX_REG13[],load:0x4->NXM_NX_REG11[],load:0x1->NXM_NX_REG12[],resubmit(,39)
 cookie=0xe2466ff3, duration=40.898s, table=39, n_packets=0, n_bytes=0, idle_age=40, priority=100,reg10=0/0x1,reg14=0x2,reg15=0x2,metadata=0x1 actions=drop
 cookie=0xe2466ff3, duration=40.898s, table=64, n_packets=0, n_bytes=0, idle_age=40, priority=100,reg10=0x1/0x1,reg15=0x2,metadata=0x1 actions=push:NXM_OF_IN_PORT[],load:0xffff->NXM_OF_IN_PORT[],resubmit(,65),pop:NXM_OF_IN_PORT[]
 cookie=0xe2466ff3, duration=40.898s, table=65, n_packets=0, n_bytes=0, idle_age=40, priority=100,reg15=0x2,metadata=0x1 actions=output:2

============= After running switch.sh ================================
============= same in_port, flows remain unchanged =======================
[root@@bz-2129866 ~]# ovn-sbctl find port_binding logical_port=ls1lp|grep uuid|cut -d: -f2| cut -c1-9
 e2466ff3
[root@@bz-2129866 ~]# COOKIE=$(ovn-sbctl find port_binding logical_port=ls1lp|grep uuid|cut -d: -f2| cut -c1-9)
[root@@bz-2129866 ~]# ovs-ofctl dump-flows br-int|grep $COOKIE
 cookie=0xe2466ff3, duration=82.937s, table=0, n_packets=3, n_bytes=210, idle_age=38, priority=100,in_port=2 actions=load:0x3->NXM_NX_REG13[],load:0x4->NXM_NX_REG11[],load:0x1->NXM_NX_REG12[],load:0x1->OXM_OF_METADATA[],load:0x2->NXM_NX_REG14[],load:0x1->NXM_NX_REG10[10],resubmit(,8)
 cookie=0xe2466ff3, duration=82.937s, table=37, n_packets=3, n_bytes=210, idle_age=38, priority=150,reg14=0x2,metadata=0x1 actions=resubmit(,38)
 cookie=0xe2466ff3, duration=82.937s, table=38, n_packets=0, n_bytes=0, idle_age=82, priority=100,reg15=0x2,metadata=0x1 actions=load:0x3->NXM_NX_REG13[],load:0x4->NXM_NX_REG11[],load:0x1->NXM_NX_REG12[],resubmit(,39)
 cookie=0xe2466ff3, duration=82.937s, table=39, n_packets=0, n_bytes=0, idle_age=82, priority=100,reg10=0/0x1,reg14=0x2,reg15=0x2,metadata=0x1 actions=drop
 cookie=0xe2466ff3, duration=82.937s, table=64, n_packets=0, n_bytes=0, idle_age=82, priority=100,reg10=0x1/0x1,reg15=0x2,metadata=0x1 actions=push:NXM_OF_IN_PORT[],load:0xffff->NXM_OF_IN_PORT[],resubmit(,65),pop:NXM_OF_IN_PORT[]
 cookie=0xe2466ff3, duration=82.937s, table=65, n_packets=0, n_bytes=0, idle_age=82, priority=100,reg15=0x2,metadata=0x1 actions=output:2
[root@@bz-2129866 ~]# ovs-vsctl del-port br-int ls1lp
================= No flows showing ======================
[root@@bz-2129866 ~]# ovs-ofctl dump-flows br-int|grep $COOKIE
[root@@bz-2129866 ~]# ovn-appctl -t ovn-controller recompute
================ After recompute, flow are back with new in_port ==============
[root@@bz-2129866 ~]# ovs-ofctl dump-flows br-int|grep $COOKIE
 cookie=0xe2466ff3, duration=2.577s, table=0, n_packets=0, n_bytes=0, idle_age=2, priority=100,in_port=3 actions=load:0x3->NXM_NX_REG13[],load:0x4->NXM_NX_REG11[],load:0x1->NXM_NX_REG12[],load:0x1->OXM_OF_METADATA[],load:0x2->NXM_NX_REG14[],load:0x1->NXM_NX_REG10[10],resubmit(,8)
 cookie=0xe2466ff3, duration=2.577s, table=37, n_packets=0, n_bytes=0, idle_age=2, priority=150,reg14=0x2,metadata=0x1 actions=resubmit(,38)
 cookie=0xe2466ff3, duration=2.577s, table=38, n_packets=0, n_bytes=0, idle_age=2, priority=100,reg15=0x2,metadata=0x1 actions=load:0x3->NXM_NX_REG13[],load:0x4->NXM_NX_REG11[],load:0x1->NXM_NX_REG12[],resubmit(,39)
 cookie=0xe2466ff3, duration=2.577s, table=39, n_packets=0, n_bytes=0, idle_age=2, priority=100,reg10=0/0x1,reg14=0x2,reg15=0x2,metadata=0x1 actions=drop
 cookie=0xe2466ff3, duration=2.577s, table=64, n_packets=0, n_bytes=0, idle_age=2, priority=100,reg10=0x1/0x1,reg15=0x2,metadata=0x1 actions=push:NXM_OF_IN_PORT[],load:0xffff->NXM_OF_IN_PORT[],resubmit(,65),pop:NXM_OF_IN_PORT[]
 cookie=0xe2466ff3, duration=2.577s, table=65, n_packets=0, n_bytes=0, idle_age=2, priority=100,reg15=0x2,metadata=0x1 actions=output:3

Verified on:
[root@@bz-2129866 ~]# rpm -qa |grep -E 'ovn|openvswitch'
ovn22.03-22.03.0-125.el8fdp.x86_64
ovn22.03-central-22.03.0-125.el8fdp.x86_64
openvswitch-selinux-extra-policy-1.0-29.el8fdp.noarch
ovn22.03-host-22.03.0-125.el8fdp.x86_64
openvswitch2.17-2.17.0-65.el8fdp.x86_64

========= After running create.sh =======================
[root@@bz-2129866 ~]# ovs-ofctl dump-flows br-int|grep $COOKIE
 cookie=0xa0c4f4f3, duration=15.651s, table=0, n_packets=6, n_bytes=476, idle_age=0, priority=100,in_port=2 actions=load:0x3->NXM_NX_REG13[],load:0x1->NXM_NX_REG11[],load:0x4->NXM_NX_REG12[],load:0x1->OXM_OF_METADATA[],load:0x2->NXM_NX_REG14[],load:0x1->NXM_NX_REG10[10],resubmit(,8)
 cookie=0xa0c4f4f3, duration=15.651s, table=37, n_packets=6, n_bytes=476, idle_age=0, priority=150,reg14=0x2,metadata=0x1 actions=resubmit(,38)
 cookie=0xa0c4f4f3, duration=15.651s, table=38, n_packets=0, n_bytes=0, idle_age=15, priority=100,reg15=0x2,metadata=0x1 actions=load:0x3->NXM_NX_REG13[],load:0x1->NXM_NX_REG11[],load:0x4->NXM_NX_REG12[],resubmit(,39)
 cookie=0xa0c4f4f3, duration=15.651s, table=39, n_packets=0, n_bytes=0, idle_age=15, priority=100,reg10=0/0x1,reg14=0x2,reg15=0x2,metadata=0x1 actions=drop
 cookie=0xa0c4f4f3, duration=15.651s, table=64, n_packets=0, n_bytes=0, idle_age=15, priority=100,reg10=0x1/0x1,reg15=0x2,metadata=0x1 actions=push:NXM_OF_IN_PORT[],load:0xffff->NXM_OF_IN_PORT[],resubmit(,65),pop:NXM_OF_IN_PORT[]
 cookie=0xa0c4f4f3, duration=15.651s, table=65, n_packets=0, n_bytes=0, idle_age=15, priority=100,reg15=0x2,metadata=0x1 actions=output:2

============= After running switch.sh ================================
============= different in_port, flows changed =======================

[root@@bz-2129866 ~]# COOKIE=$(ovn-sbctl find port_binding logical_port=ls1lp|grep uuid|cut -d: -f2| cut -c1-9)
[root@@bz-2129866 ~]# ovs-ofctl dump-flows br-int|grep $COOKIE
 cookie=0xa0c4f4f3, duration=0.014s, table=0, n_packets=0, n_bytes=0, idle_age=0, priority=100,in_port=3 actions=load:0x3->NXM_NX_REG13[],load:0x1->NXM_NX_REG11[],load:0x4->NXM_NX_REG12[],load:0x1->OXM_OF_METADATA[],load:0x2->NXM_NX_REG14[],load:0x1->NXM_NX_REG10[10],resubmit(,8)
 cookie=0xa0c4f4f3, duration=29.248s, table=37, n_packets=6, n_bytes=476, idle_age=14, priority=150,reg14=0x2,metadata=0x1 actions=resubmit(,38)
 cookie=0xa0c4f4f3, duration=29.248s, table=38, n_packets=0, n_bytes=0, idle_age=29, priority=100,reg15=0x2,metadata=0x1 actions=load:0x3->NXM_NX_REG13[],load:0x1->NXM_NX_REG11[],load:0x4->NXM_NX_REG12[],resubmit(,39)
 cookie=0xa0c4f4f3, duration=29.248s, table=39, n_packets=0, n_bytes=0, idle_age=29, priority=100,reg10=0/0x1,reg14=0x2,reg15=0x2,metadata=0x1 actions=drop
 cookie=0xa0c4f4f3, duration=29.248s, table=64, n_packets=0, n_bytes=0, idle_age=29, priority=100,reg10=0x1/0x1,reg15=0x2,metadata=0x1 actions=push:NXM_OF_IN_PORT[],load:0xffff->NXM_OF_IN_PORT[],resubmit(,65),pop:NXM_OF_IN_PORT[]
 cookie=0xa0c4f4f3, duration=0.014s, table=65, n_packets=0, n_bytes=0, idle_age=0, priority=100,reg15=0x2,metadata=0x1 actions=output:3

================= Flows are shown, no need to recompute ====================== 
[root@@bz-2129866 ~]# ovs-vsctl del-port br-int ls1lp
[root@@bz-2129866 ~]# ovs-ofctl dump-flows br-int|grep $COOKIE
 cookie=0xa0c4f4f3, duration=70.906s, table=0, n_packets=9, n_bytes=706, idle_age=9, priority=100,in_port=3 actions=load:0x3->NXM_NX_REG13[],load:0x1->NXM_NX_REG11[],load:0x4->NXM_NX_REG12[],load:0x1->OXM_OF_METADATA[],load:0x2->NXM_NX_REG14[],load:0x1->NXM_NX_REG10[10],resubmit(,8)
 cookie=0xa0c4f4f3, duration=100.140s, table=37, n_packets=15, n_bytes=1182, idle_age=9, priority=150,reg14=0x2,metadata=0x1 actions=resubmit(,38)
 cookie=0xa0c4f4f3, duration=100.140s, table=38, n_packets=0, n_bytes=0, idle_age=100, priority=100,reg15=0x2,metadata=0x1 actions=load:0x3->NXM_NX_REG13[],load:0x1->NXM_NX_REG11[],load:0x4->NXM_NX_REG12[],resubmit(,39)
 cookie=0xa0c4f4f3, duration=100.140s, table=39, n_packets=0, n_bytes=0, idle_age=100, priority=100,reg10=0/0x1,reg14=0x2,reg15=0x2,metadata=0x1 actions=drop
 cookie=0xa0c4f4f3, duration=100.140s, table=64, n_packets=0, n_bytes=0, idle_age=100, priority=100,reg10=0x1/0x1,reg15=0x2,metadata=0x1 actions=push:NXM_OF_IN_PORT[],load:0xffff->NXM_OF_IN_PORT[],resubmit(,65),pop:NXM_OF_IN_PORT[]
 cookie=0xa0c4f4f3, duration=70.906s, table=65, n_packets=0, n_bytes=0, idle_age=70, priority=100,reg15=0x2,metadata=0x1 actions=output:3

Comment 5 errata-xmlrpc 2022-12-15 15:26:33 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (ovn22.03 bug fix and enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2022:9059