Bug 1850511
| Summary: | [ovn] Considerable amount of SB transactions with 'registering chassis' observed | ||
|---|---|---|---|
| Product: | Red Hat Enterprise Linux Fast Datapath | Reporter: | Daniel Alvarez Sanchez <dalvarez> |
| Component: | ovn2.13 | Assignee: | Dumitru Ceara <dceara> |
| Status: | CLOSED ERRATA | QA Contact: | Jianlin Shi <jishi> |
| Severity: | medium | Docs Contact: | |
| Priority: | medium | ||
| Version: | FDP 20.B | CC: | ctrautma, dceara, jishi, ralongi |
| Target Milestone: | --- | ||
| Target Release: | --- | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | If docs needed, set a value | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2020-08-18 11:23:51 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
Fix posted for review: https://patchwork.ozlabs.org/project/openvswitch/patch/1593071870-14943-1-git-send-email-dceara@redhat.com/ setup env with following script: systemctl start openvswitch systemctl start ovn-northd ovn-nbctl set-connection ptcp:6641 ovn-sbctl set-connection ptcp:6642 ovs-vsctl set open . external_ids:system-id=hv1 external_ids:ovn-remote=tcp:20.0.31.25:6642 external_ids:ovn-encap-type=geneve external_ids:ovn-encap-ip=20.0.31.25 systemctl restart ovn-controller ovn-nbctl ls-add ls1 ovn-nbctl lsp-add ls1 ls1p1 ovs-vsctl add-port br-int p1 -- set interface p1 type=internal ovs-vsctl set interface p1 external_ids:iface-id=ls1p1 ovn-nbctl acl-add ls1 from-lport 1000 "inport==ls1p1 && tcp" drop reproduced on ovn2.13.0-39: [root@dell-per740-12 bz1850511]# grep comment /var/lib/ovn/ovnsb_db.db {"_date":1594704515162,"SB_Global":{"f9f2efb7-7545-4f33-8c49-4ccbc39b65a1":{}},"_comment":"ovs-sbctl: ovn-sbctl init"} {"_date":1594704515214,"SB_Global":{"f9f2efb7-7545-4f33-8c49-4ccbc39b65a1":{"connections":["uuid","13f57d8e-cf3f-4d7b-8954-26e18a251e9d"]}},"_comment":"ovs-sbctl: ovn-sbctl set-connection ptcp:6642","Conn ection":{"13f57d8e-cf3f-4d7b-8954-26e18a251e9d":{"target":"ptcp:6642"}}} {"Chassis":{"4a166802-a997-4131-bde1-7b4375253592":{"name":"hv1","hostname":"dell-per740-12.rhts.eng.pek2.redhat.com","encaps":["uuid","90c057a9-698d-4d6d-a411-c6d679fc6897"],"external_ids":["map",[["data path-type",""],["iface-types","erspan,geneve,gre,internal,ip6erspan,ip6gre,lisp,patch,stt,system,tap,vxlan"],["is-interconn","false"],["ovn-bridge-mappings",""],["ovn-chassis-mac-mappings",""],["ovn-cms-o ptions",""]]]}},"Encap":{"90c057a9-698d-4d6d-a411-c6d679fc6897":{"ip":"20.0.31.25","options":["map",[["csum","true"]]],"chassis_name":"hv1","type":"geneve"}},"_date":1594704515351,"_comment":"ovn-controll er: registering chassis 'hv1'"} {"_date":1594704547737,"Port_Binding":{"c35d6178-0234-43b2-8a8d-7aa6fb8a93d8":{"chassis":["uuid","4a166802-a997-4131-bde1-7b4375253592"]}},"_comment":"ovn-controller: registering chassis 'hv1'"} <==== comment is added when bind port verified on ovn2.13-host-20.06.1-2.el7fdp.x86_64: [root@dell-per740-12 bz1850511]# rpm -qa | grep -E "openvswitch|ovn" kernel-kernel-networking-openvswitch-ovn-common-1.0-7.noarch ovn2.13-host-20.06.1-2.el7fdp.x86_64 openvswitch2.13-2.13.0-10.el7fdp.x86_64 ovn2.13-central-20.06.1-2.el7fdp.x86_64 openvswitch-selinux-extra-policy-1.0-15.el7fdp.noarch ovn2.13-20.06.1-2.el7fdp.x86_64 [root@dell-per740-12 bz1850511]# grep comment /var/lib/ovn/ovnsb_db.db {"_date":1594704647629,"SB_Global":{"ffc7088a-c7b6-446f-99d2-83ecf1aa64c0":{}},"_comment":"ovs-sbctl: ovn-sbctl --no-leader-only init"} {"_date":1594704647686,"SB_Global":{"ffc7088a-c7b6-446f-99d2-83ecf1aa64c0":{"connections":["uuid","3e3e8787-73d9-4d98-b320-fb9edd95fd81"]}},"_comment":"ovs-sbctl: ovn-sbctl set-connection ptcp:6642","Connection":{"3e3e8787-73d9-4d98-b320-fb9edd95fd81":{"target":"ptcp:6642"}}} {"Chassis":{"ae69181f-fb26-4a57-88c0-99587ea211cc":{"name":"hv1","hostname":"dell-per740-12.rhts.eng.pek2.redhat.com","other_config":["map",[["datapath-type",""],["iface-types","erspan,geneve,gre,internal,ip6erspan,ip6gre,lisp,patch,stt,system,tap,vxlan"],["is-interconn","false"],["ovn-bridge-mappings",""],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""]]],"external_ids":["map",[["datapath-type",""],["iface-types","erspan,geneve,gre,internal,ip6erspan,ip6gre,lisp,patch,stt,system,tap,vxlan"],["is-interconn","false"],["ovn-bridge-mappings",""],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""]]],"encaps":["uuid","7c2228a7-f8a4-4eab-a9bc-efd838c723ea"]}},"Encap":{"7c2228a7-f8a4-4eab-a9bc-efd838c723ea":{"ip":"20.0.31.25","options":["map",[["csum","true"]]],"chassis_name":"hv1","type":"geneve"}},"_date":1594704647834,"_comment":"ovn-controller: registering chassis 'hv1'"} <==== no comment is added when bind port [root@dell-per740-12 bz1850511]# ovn-sbctl show Chassis hv1 hostname: dell-per740-12.rhts.eng.pek2.redhat.com Encap geneve ip: "20.0.31.25" options: {csum="true"} Port_Binding ls1p1 also verified on rhel8 version: [root@hp-dl380pg8-12 bz1850511]# grep comment /var/lib/ovn/ovnsb_db.db {"_date":1594705913301,"SB_Global":{"95893a95-db90-4b7e-9ca4-8800063ac444":{}},"_comment":"ovs-sbctl: ovn-sbctl --no-leader-only init"} {"_date":1594705913347,"SB_Global":{"95893a95-db90-4b7e-9ca4-8800063ac444":{"connections":["uuid","d0e97a53-0934-4393-8286-5343274c6c4c"]}},"_comment":"ovs-sbctl: ovn-sbctl set-connection ptcp:6642","Connection":{"d0e97a53-0934-4393-8286-5343274c6c4c":{"target":"ptcp:6642"}}} {"Chassis":{"fe2fa57b-02ee-48e2-9793-0c0332840794":{"name":"hv1","hostname":"hp-dl380pg8-12.rhts.eng.pek2.redhat.com","other_config":["map",[["datapath-type",""],["iface-types","erspan,geneve,gre,internal,ip6erspan,ip6gre,lisp,patch,stt,system,tap,vxlan"],["is-interconn","false"],["ovn-bridge-mappings",""],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""]]],"external_ids":["map",[["datapath-type",""],["iface-types","erspan,geneve,gre,internal,ip6erspan,ip6gre,lisp,patch,stt,system,tap,vxlan"],["is-interconn","false"],["ovn-bridge-mappings",""],["ovn-chassis-mac-mappings",""],["ovn-cms-options",""]]],"encaps":["uuid","caeb33c5-882f-474f-a23a-864ec4e2dacb"]}},"Encap":{"caeb33c5-882f-474f-a23a-864ec4e2dacb":{"ip":"20.0.111.25","options":["map",[["csum","true"]]],"chassis_name":"hv1","type":"geneve"}},"_date":1594705913469,"_comment":"ovn-controller: registering chassis 'hv1'"} <=== no comment added for port_binding [root@hp-dl380pg8-12 bz1850511]# rpm -qa | grep -E "openvswitch|ovn" ovn2.13-host-20.06.1-2.el8fdp.x86_64 openvswitch-selinux-extra-policy-1.0-23.el8fdp.noarch ovn2.13-20.06.1-2.el8fdp.x86_64 openvswitch2.13-2.13.0-41.el8fdb.x86_64 ovn2.13-central-20.06.1-2.el8fdp.x86_64 o[root@hp-dl380pg8-12 bz1850511]# ovn-sbctl show Chassis hv1 hostname: hp-dl380pg8-12.rhts.eng.pek2.redhat.com Encap geneve ip: "20.0.111.25" options: {csum="true"} Port_Binding ls1p1 Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (ovn2.13 bug fix and enhancement update), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2020:3488 |
By inspecting the SB network traffic and the transactions in the DB file, I can see multiple messages like the ones below: {"Chassis":{"9e17ebb5-f66c-4155-832d-91ddd173dd64":{"nb_cfg":10269}},"_date":1593001391547,"_comment":"ovn-controller: registering chassis '0afeb2d9-1043-41c1-b20b-2b69bf47f8be'"} OVSDB JSON 180 6c5ab5014f606aab3dd0789c281d5b2101d018ab {"Chassis":{"65885aa1-ed24-40e4-882c-0531f1fa69d6":{"nb_cfg":10269}},"_date":1593001391548,"_comment":"ovn-controller: registering chassis '475c403a-3b29-45df-9324-0b7d4998162b'"} OVSDB JSON 180 99f8e33b3fabaafa5463d4479ee8e20a8759ebd3 {"Chassis":{"a1138f17-4440-4720-94ae-2eef7e8c1e4c":{"nb_cfg":10269}},"_date":1593001391548,"_comment":"ovn-controller: registering chassis '5ff91d0c-b40f-449f-8224-7e29a39f14cf'"} I wonder if we could avoid these to reduce the load on ovsdb server and at the same time reduce the network traffic as it might be considerable amount of transactions/load/traffic in environments with a high number of nodes.