Bug 1838166

Summary:	Error with large openflow messages
Product:	Red Hat Enterprise Linux Fast Datapath	Reporter:	Mark Michelson <mmichels>
Component:	ovn2.13	Assignee:	OVN Team <ovnteam>
Status:	CLOSED ERRATA	QA Contact:	Jianlin Shi <jishi>
Severity:	medium	Docs Contact:
Priority:	medium
Version:	RHEL 7.7	CC:	ctrautma, dcbw, jishi, ralongi, rkhan, tredaelli, yinxu
Target Milestone:	---
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:	1779854	Environment:
Last Closed:	2020-05-26 14:07:18 UTC	Type:	---
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:	1779854
Bug Blocks:	1837593

Comment 3 ying xu 2020-05-21 09:53:40 UTC

use the reproducer provided in the bug ,I reproduced on version:
# rpm -qa|grep ovn
ovn2.13-2.13.0-21.el7fdp.x86_64
ovn2.13-central-2.13.0-21.el7fdp.x86_64
ovn2.13-host-2.13.0-21.el7fdp.x86_64

2020-05-21T03:34:36.048Z|00023|ofctrl|INFO|OpenFlow error: OFPT_ERROR (xid=0xffffffff): OFPBRC_BAD_VERSION
***decode error: OFPBRC_BAD_TYPE***
00000000  00 40 00 64 ff ff ff ff-ff ff ff ff 00 00 00 00 |.@.d............|
00000010  ff ff 00 30 00 00 23 20-00 23 00 01 00 01 1a 04 |...0..# .#......|
00000020  00 0f 13 00 00 00 00 00-ff ff 00 18 00 00 23 20 |..............# |
00000030  00 24 00 00 00 02 00 11-c0 a9 02 ef 00 50 00 00 |.$...........P..|
00000040  00 40 00 64 ff ff ff ff-ff ff ff ff 00 00 00 00 |.@.d............|
00000050  ff ff 00 30 00 00 23 20-00 23 00 01 00 01 1a 04 |...0..# .#......|
00000060  00 0f 13 00                                     |....            |
2020-05-21T03:34:36.049Z|00024|vconn_stream|ERR|send: Broken pipe
2020-05-21T03:34:36.049Z|00025|rconn|WARN|unix:/run/openvswitch/br-int.mgmt: connection dropped (Broken pipe)
2020-05-21T03:34:37.050Z|00026|rconn|INFO|unix:/run/openvswitch/br-int.mgmt: connecting...
2020-05-21T03:34:37.051Z|00027|rconn|INFO|unix:/run/openvswitch/br-int.mgmt: connected
2020-05-21T03:34:37.280Z|00028|ofctrl|INFO|OpenFlow error: OFPT_ERROR (xid=0xffffffff): OFPBRC_BAD_VERSION
***decode error: OFPBRC_BAD_TYPE***
00000000  00 40 00 64 ff ff ff ff-ff ff ff ff 00 00 00 00 |.@.d............|
00000010  ff ff 00 30 00 00 23 20-00 23 00 01 00 01 1a 04 |...0..# .#......|
00000020  00 0f 13 00 00 00 00 00-ff ff 00 18 00 00 23 20 |..............# |
00000030  00 24 00 00 00 02 00 11-c0 a9 02 ef 00 50 00 00 |.$...........P..|
00000040  00 40 00 64 ff ff ff ff-ff ff ff ff 00 00 00 00 |.@.d............|
00000050  ff ff 00 30 00 00 23 20-00 23 00 01 00 01 1a 04 |...0..# .#......|
00000060  00 0f 13 00                                     |....            |
2020-05-21T03:34:37.280Z|00029|vconn_stream|ERR|send: Broken pipe
2020-05-21T03:34:37.280Z|00030|rconn|WARN|unix:/run/openvswitch/br-int.mgmt: connection dropped (Broken pipe)
2020-05-21T03:34:37.281Z|00031|rconn|INFO|unix:/run/openvswitch/br-int.mgmt: waiting 2 seconds before reconnect
2020-05-21T03:34:39.283Z|00032|rconn|INFO|unix:/run/openvswitch/br-int.mgmt: connecting...
2020-05-21T03:34:39.283Z|00033|rconn|INFO|unix:/run/openvswitch/br-int.mgmt: connected
2020-05-21T03:34:39.512Z|00034|ofctrl|INFO|OpenFlow error: OFPT_ERROR (xid=0xffffffff): OFPBRC_BAD_VERSION
***decode error: OFPBRC_BAD_TYPE***
00000000  00 40 00 64 ff ff ff ff-ff ff ff ff 00 00 00 00 |.@.d............|
00000010  ff ff 00 30 00 00 23 20-00 23 00 01 00 01 1a 04 |...0..# .#......|
00000020  00 0f 13 00 00 00 00 00-ff ff 00 18 00 00 23 20 |..............# |
00000030  00 24 00 00 00 02 00 11-c0 a9 02 ef 00 50 00 00 |.$...........P..|
00000040  00 40 00 64 ff ff ff ff-ff ff ff ff 00 00 00 00 |.@.d............|
00000050  ff ff 00 30 00 00 23 20-00 23 00 01 00 01 1a 04 |...0..# .#......|
00000060  00 0f 13 00                                     |....            |
2020-05-21T03:34:39.512Z|00035|rconn|WARN|unix:/run/openvswitch/br-int.mgmt: connection dropped (Connection reset by peer)
2020-05-21T03:34:39.513Z|00036|rconn|INFO|unix:/run/openvswitch/br-int.mgmt: waiting 4 seconds before reconnect
2020-05-21T03:34:43.517Z|00037|rconn|INFO|unix:/run/openvswitch/br-int.mgmt: connecting...
2020-05-21T03:34:43.518Z|00038|rconn|INFO|unix:/run/openvswitch/br-int.mgmt: connected
2020-05-21T03:34:43.749Z|00039|ofctrl|INFO|OpenFlow error: OFPT_ERROR (xid=0xffffffff): OFPBRC_BAD_VERSION
***decode error: OFPBRC_BAD_TYPE***
00000000  00 40 00 64 ff ff ff ff-ff ff ff ff 00 00 00 00 |.@.d............|
00000010  ff ff 00 30 00 00 23 20-00 23 00 01 00 01 1a 04 |...0..# .#......|
00000020  00 0f 13 00 00 00 00 00-ff ff 00 18 00 00 23 20 |..............# |
00000030  00 24 00 00 00 02 00 11-c0 a9 02 ef 00 50 00 00 |.$...........P..|
00000040  00 40 00 64 ff ff ff ff-ff ff ff ff 00 00 00 00 |.@.d............|
00000050  ff ff 00 30 00 00 23 20-00 23 00 01 00 01 1a 04 |...0..# .#......|
00000060  00 0f 13 00                                     |....            |
2020-05-21T03:34:43.749Z|00040|vconn_stream|ERR|send: Broken pipe
2020-05-21T03:34:43.749Z|00041|rconn|WARN|unix:/run/openvswitch/br-int.mgmt: connection dropped (Broken pipe)
2020-05-21T03:34:43.750Z|00042|rconn|INFO|unix:/run/openvswitch/br-int.mgmt: continuing to retry connections in the background but suppressing further logging
2020-05-21T03:34:51.753Z|00043|rconn|INFO|unix:/run/openvswitch/br-int.mgmt: connected
2020-05-21T03:34:51.983Z|00044|ofctrl|INFO|OpenFlow error: OFPT_ERROR (xid=0xffffffff): OFPBRC_BAD_VERSION
***decode error: OFPBRC_BAD_TYPE***
00000000  00 40 00 64 ff ff ff ff-ff ff ff ff 00 00 00 00 |.@.d............|
00000010  ff ff 00 30 00 00 23 20-00 23 00 01 00 01 1a 04 |...0..# .#......|
00000020  00 0f 13 00 00 00 00 00-ff ff 00 18 00 00 23 20 |..............# |
00000030  00 24 00 00 00 02 00 11-c0 a9 02 ef 00 50 00 00 |.$...........P..|
00000040  00 40 00 64 ff ff ff ff-ff ff ff ff 00 00 00 00 |.@.d............|
00000050  ff ff 00 30 00 00 23 20-00 23 00 01 00 01 1a 04 |...0..# .#......|
00000060  00 0f 13 00                                     |....            |
2020-05-21T03:34:51.983Z|00045|vconn_stream|ERR|send: Broken pipe
2020-05-21T03:34:51.983Z|00046|rconn|WARN|unix:/run/openvswitch/br-int.mgmt: connection dropped (Broken pipe)
2020-05-21T03:34:59.984Z|00047|rconn|INFO|unix:/run/openvswitch/br-int.mgmt: connected
2020-05-21T03:35:00.216Z|00048|ofctrl|INFO|OpenFlow error: OFPT_ERROR (xid=0xffffffff): OFPBRC_BAD_VERSION
***decode error: OFPBRC_BAD_TYPE***
00000000  00 40 00 64 ff ff ff ff-ff ff ff ff 00 00 00 00 |.@.d............|
00000010  ff ff 00 30 00 00 23 20-00 23 00 01 00 01 1a 04 |...0..# .#......|
00000020  00 0f 13 00 00 00 00 00-ff ff 00 18 00 00 23 20 |..............# |
00000030  00 24 00 00 00 02 00 11-c0 a9 02 ef 00 50 00 00 |.$...........P..|
00000040  00 40 00 64 ff ff ff ff-ff ff ff ff 00 00 00 00 |.@.d............|
00000050  ff ff 00 30 00 00 23 20-00 23 00 01 00 01 1a 04 |...0..# .#......|
00000060  00 0f 13 00                                     |....            |
2020-05-21T03:35:00.216Z|00049|vconn_stream|ERR|send: Broken pipe
2020-05-21T03:35:00.216Z|00050|rconn|WARN|unix:/run/openvswitch/br-int.mgmt: connection dropped (Broken pipe)
2020-05-21T03:35:08.221Z|00051|rconn|INFO|unix:/run/openvswitch/br-int.mgmt: connected
2020-05-21T03:35:08.460Z|00052|ofctrl|INFO|OpenFlow error: OFPT_ERROR (xid=0xffffffff): OFPBRC_BAD_VERSION
***decode error: OFPBRC_BAD_TYPE***
00000000  00 40 00 64 ff ff ff ff-ff ff ff ff 00 00 00 00 |.@.d............|
00000010  ff ff 00 30 00 00 23 20-00 23 00 01 00 01 1a 04 |...0..# .#......|
00000020  00 0f 13 00 00 00 00 00-ff ff 00 18 00 00 23 20 |..............# |
00000030  00 24 00 00 00 02 00 11-c0 a9 02 ef 00 50 00 00 |.$...........P..|
00000040  00 40 00 64 ff ff ff ff-ff ff ff ff 00 00 00 00 |.@.d............|
00000050  ff ff 00 30 00 00 23 20-00 23 00 01 00 01 1a 04 |...0..# .#......|
00000060  00 0f 13 00                                     |....            |
2020-05-21T03:35:08.460Z|00053|vconn_stream|ERR|send: Broken pipe
2020-05-21T03:35:08.460Z|00054|rconn|WARN|unix:/run/openvswitch/br-int.mgmt: connection dropped (Broken pipe)

I verified on version:
# rpm -qa|grep ovn
ovn2.13-2.13.0-31.el7fdp.x86_64
ovn2.13-central-2.13.0-31.el7fdp.x86_64
ovn2.13-host-2.13.0-31.el7fdp.x86_64

# cat /var/log/ovn/ovn-controller.log 
2020-05-21T03:46:19.172Z|00001|vlog|INFO|opened log file /var/log/ovn/ovn-controller.log
2020-05-21T03:46:19.175Z|00002|reconnect|INFO|unix:/run/openvswitch/db.sock: connecting...
2020-05-21T03:46:19.175Z|00003|reconnect|INFO|unix:/run/openvswitch/db.sock: connected
2020-05-21T03:46:19.179Z|00004|main|INFO|OVS IDL reconnected, force recompute.
2020-05-21T03:46:19.179Z|00005|reconnect|INFO|tcp:20.0.10.25:6642: connecting...
2020-05-21T03:46:19.179Z|00006|main|INFO|OVNSB IDL reconnected, force recompute.
2020-05-21T03:46:19.180Z|00007|reconnect|INFO|tcp:20.0.10.25:6642: connected
2020-05-21T03:46:19.184Z|00008|ofctrl|INFO|unix:/run/openvswitch/br-int.mgmt: connecting to switch
2020-05-21T03:46:19.184Z|00009|rconn|INFO|unix:/run/openvswitch/br-int.mgmt: connecting...
2020-05-21T03:46:19.184Z|00010|rconn|WARN|unix:/run/openvswitch/br-int.mgmt: connection failed (No such file or directory)
2020-05-21T03:46:19.184Z|00011|rconn|INFO|unix:/run/openvswitch/br-int.mgmt: waiting 1 seconds before reconnect
2020-05-21T03:46:20.185Z|00012|rconn|INFO|unix:/run/openvswitch/br-int.mgmt: connecting...
2020-05-21T03:46:20.186Z|00013|rconn|INFO|unix:/run/openvswitch/br-int.mgmt: connected
2020-05-21T03:46:20.191Z|00014|dpif_netlink|INFO|The kernel module does not support meters.
2020-05-21T03:46:20.194Z|00001|pinctrl(ovn_pinctrl0)|INFO|unix:/run/openvswitch/br-int.mgmt: connecting to switch
2020-05-21T03:46:20.194Z|00002|rconn(ovn_pinctrl0)|INFO|unix:/run/openvswitch/br-int.mgmt: connecting...
2020-05-21T03:46:20.195Z|00003|rconn(ovn_pinctrl0)|INFO|unix:/run/openvswitch/br-int.mgmt: connected
2020-05-21T03:46:40.793Z|00004|rconn(ovn_pinctrl0)|INFO|unix:/run/openvswitch/br-int.mgmt: connection closed by peer
2020-05-21T03:46:40.793Z|00015|rconn|INFO|unix:/run/openvswitch/br-int.mgmt: connection closed by peer
2020-05-21T03:46:41.040Z|00016|binding|INFO|Claiming lport ls1p1 for this chassis.
2020-05-21T03:46:41.040Z|00017|binding|INFO|ls1p1: Claiming 00:01:02:01:01:01
2020-05-21T03:46:41.610Z|00018|binding|INFO|Claiming lport ls1p2 for this chassis.
2020-05-21T03:46:41.610Z|00019|binding|INFO|ls1p2: Claiming 00:01:02:01:01:02
2020-05-21T03:46:41.793Z|00020|rconn|INFO|unix:/run/openvswitch/br-int.mgmt: connecting...
2020-05-21T03:46:41.793Z|00005|rconn(ovn_pinctrl0)|INFO|unix:/run/openvswitch/br-int.mgmt: connecting...
2020-05-21T03:46:41.794Z|00021|rconn|INFO|unix:/run/openvswitch/br-int.mgmt: connected
2020-05-21T03:46:41.794Z|00006|rconn(ovn_pinctrl0)|INFO|unix:/run/openvswitch/br-int.mgmt: connected
[root@dell-per730-19 load_balance]# cat /var/log/ovn/ovn-controller.log |grep "OpenFlow error"

Comment 7 errata-xmlrpc 2020-05-26 14:07:18 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:2317