Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.
The FDP team is no longer accepting new bugs in Bugzilla. Please report your issues under FDP project in Jira. Thanks.

Bug 1714592

Summary: [openvswitch] observed the difference between dpctl and nic statistics
Product: Red Hat Enterprise Linux Fast Datapath Reporter: Haresh Khandelwal <hakhande>
Component: openvswitchAssignee: David Marchand <dmarchan>
openvswitch sub component: ovs-dpdk QA Contact: qding
Status: CLOSED ERRATA Docs Contact:
Severity: medium    
Priority: medium CC: apevec, atragler, chrisw, ctrautma, dmarchan, fhallal, jhsiao, kfida, ktraynor, rhos-maint, tli, tredaelli
Version: FDP 18.04   
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of:
: 1728610 (view as bug list) Environment:
Last Closed: 2019-08-20 11:09:01 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1728610    

Description Haresh Khandelwal 2019-05-28 11:56:17 UTC 
Description of problem:

Read rx_dropped below. 
>>>>ovs-vsctl get Interface dpdk1 statistics
{mac_local_errors=0, mac_remote_errors=0, "rx_1024_to_1522_packets"=12932743603, "rx_128_to_255_packets"=15823339847, "rx_1523_to_max_packets"=641238, "rx_1_to_64_packets"=87656383, "rx_256_to_511_packets"=612383722, "rx_512_to_1023_packets"=2920585552, "rx_65_to_127_packets"=4612990450, rx_broadcast_packets=5430360, rx_bytes=23422170505752, rx_crc_errors=0, rx_dropped=0, rx_errors=0, rx_fragmented_errors=0, rx_illegal_byte_errors=0, rx_jabber_errors=0, rx_length_errors=0, rx_mac_short_dropped=0, rx_mbuf_allocation_errors=0, rx_oversize_errors=0, rx_packets=36990336866, rx_undersized_errors=0, "tx_1024_to_1522_packets"=21070368370, "tx_128_to_255_packets"=2426923106, "tx_1523_to_max_packets"=15820, "tx_1_to_64_packets"=12233712, "tx_256_to_511_packets"=207202811, "tx_512_to_1023_packets"=1672670598, "tx_65_to_127_packets"=23550248, tx_broadcast_packets=6418, tx_bytes=29735794313460, tx_dropped=0, tx_errors=0, tx_link_down_dropped=0, tx_multicast_packets=171240, tx_packets=25412964629}

However at below, it shows drops. 
>>>>ovs-appctl dpctl/show -s
netdev@ovs-netdev:
        lookups: hit:4950946 missed:4243 lost:0
        flows: 290
	.....
        port 4: dpdk1 (dpdk: configured_rx_queues=1, configured_rxq_descriptors=2048, configured_tx_queues=5, configured_txq_descriptors=2048, mtu=2140, requested_rx_queues=1, requested_rxq_descriptors=2048, requested_tx_queues=5, requested_txq_descriptors=2048, rx_csum_offload=true)
                RX packets:37270817956 errors:0 dropped:3890 overruns:? frame:?
                TX packets:25604931542 errors:0 dropped:0 aborted:? carrier:?
                collisions:?
                RX bytes:23595470606099 (21.5 TiB)  TX bytes:29962981635899 (27.3 TiB)

While i understand earlier command fetches statistics from the ovsdb for concern port and displaying port level statistics and later from data path. However one thing puzzling me is drop count at later. 

This behavior observed on Intel X710/XXV710 (i40e drivers).

Version-Release number of selected component (if applicable):
ovs 2.9.0-97.el7fdp

How reproducible:
just observed both commands. 

Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:
Same stats at both commands. 

Additional info:
Comment 13 qding 2019-07-23 02:46:16 UTC 
Reproduced:

[root@dell-per730-04 ~]# rpm -q openvswitch
openvswitch-2.9.0-97.el7fdp.x86_64
[root@dell-per730-04 ~]# ovs-vsctl get Interface dpdk0 statistics
{mac_local_errors=10, mac_remote_errors=6, "rx_1024_to_1522_packets"=0, "rx_128_to_255_packets"=5, "rx_1523_to_max_packets"=0, "rx_1_to_64_packets"=8, "rx_256_to_511_packets"=0, "rx_512_to_1023_packets"=10, "rx_65_to_127_packets"=25654943, rx_broadcast_packets=1, rx_bytes=1643849708, rx_crc_errors=0, rx_dropped=0, rx_errors=0, rx_fragmented_errors=0, rx_illegal_byte_errors=0, rx_jabber_errors=0, rx_length_errors=0, rx_mac_short_dropped=0, rx_mbuf_allocation_errors=0, rx_oversize_errors=0, rx_packets=18247275, rx_undersized_errors=0, "tx_1024_to_1522_packets"=777627, "tx_128_to_255_packets"=0, "tx_1523_to_max_packets"=0, "tx_1_to_64_packets"=5, "tx_256_to_511_packets"=4134, "tx_512_to_1023_packets"=2, "tx_65_to_127_packets"=43404, tx_broadcast_packets=1, tx_bytes=1183348132, tx_dropped=0, tx_errors=0, tx_link_down_dropped=0, tx_multicast_packets=80, tx_packets=825172}
[root@dell-per730-04 ~]# 
[root@dell-per730-04 ~]# ovs-appctl dpctl/show -s
netdev@ovs-netdev:
	lookups: hit:19072345 missed:30 lost:0
	flows: 0
	port 0: ovs-netdev (tap)
		RX packets:0 errors:0 dropped:0 overruns:0 frame:0
		TX packets:0 errors:0 dropped:0 aborted:0 carrier:0
		collisions:0
		RX bytes:0  TX bytes:0
	port 1: dpdk0 (dpdk: configured_rx_queues=1, configured_rxq_descriptors=2048, configured_tx_queues=9, configured_txq_descriptors=2048, mtu=1500, requested_rx_queues=1, requested_rxq_descriptors=2048, requested_tx_queues=9, requested_txq_descriptors=2048, rx_csum_offload=true)
		RX packets:18247275 errors:0 dropped:7407691 overruns:? frame:?
		TX packets:825172 errors:0 dropped:0 aborted:? carrier:?
		collisions:?
		RX bytes:1643849708 (1.5 GiB)  TX bytes:1183348132 (1.1 GiB)
	port 2: ovsbr0 (tap)
		RX packets:825100 errors:0 dropped:15057203 overruns:0 frame:0
		TX packets:18247275 errors:0 dropped:0 aborted:0 carrier:0
		collisions:0
		RX bytes:1183348042 (1.1 GiB)  TX bytes:1169757484 (1.1 GiB)
	port 3: dpdk1 (dpdk: configured_rx_queues=1, configured_rxq_descriptors=2048, configured_tx_queues=9, configured_txq_descriptors=2048, mtu=1500, requested_rx_queues=1, requested_rxq_descriptors=2048, requested_tx_queues=9, requested_txq_descriptors=2048, rx_csum_offload=true)
		RX packets:0 errors:0 dropped:0 overruns:? frame:?
		TX packets:18009766 errors:0 dropped:0 aborted:? carrier:?
		collisions:?
		RX bytes:0  TX bytes:1152622658 (1.1 GiB)


Verified:

[root@dell-per730-04 ~]# rpm -q openvswitch
openvswitch-2.9.0-114.el7fdp.x86_64
[root@dell-per730-04 ~]# 
[root@dell-per730-04 ~]# ovs-vsctl get Interface dpdk0 statistics
{mac_local_errors=0, mac_remote_errors=0, "rx_1024_to_1522_packets"=0, "rx_128_to_255_packets"=0, "rx_1523_to_max_packets"=0, "rx_1_to_64_packets"=0, "rx_256_to_511_packets"=0, "rx_512_to_1023_packets"=0, "rx_65_to_127_packets"=29997501, rx_broadcast_packets=0, rx_bytes=1919840064, rx_crc_errors=0, rx_dropped=9110911, rx_errors=0, rx_fragmented_errors=0, rx_illegal_byte_errors=0, rx_jabber_errors=0, rx_length_errors=0, rx_mac_short_dropped=0, rx_mbuf_allocation_errors=0, rx_missed_errors=9110911, rx_oversize_errors=0, rx_packets=20886590, rx_undersized_errors=0, "tx_1024_to_1522_packets"=0, "tx_128_to_255_packets"=0, "tx_1523_to_max_packets"=0, "tx_1_to_64_packets"=0, "tx_256_to_511_packets"=0, "tx_512_to_1023_packets"=0, "tx_65_to_127_packets"=4, tx_broadcast_packets=0, tx_bytes=0, tx_dropped=0, tx_errors=0, tx_link_down_dropped=0, tx_multicast_packets=4, tx_packets=4}
[root@dell-per730-04 ~]# ovs-appctl dpctl/show -s
netdev@ovs-netdev:
	lookups: hit:20886589 missed:1 lost:0
	flows: 0
	port 0: ovs-netdev (tap)
		RX packets:0 errors:0 dropped:0 overruns:0 frame:0
		TX packets:0 errors:0 dropped:0 aborted:0 carrier:0
		collisions:0
		RX bytes:0  TX bytes:0
	port 1: dpdk1 (dpdk: configured_rx_queues=1, configured_rxq_descriptors=2048, configured_tx_queues=9, configured_txq_descriptors=2048, mtu=1500, requested_rx_queues=1, requested_rxq_descriptors=2048, requested_tx_queues=9, requested_txq_descriptors=2048, rx_csum_offload=true)
		RX packets:0 errors:0 dropped:0 overruns:? frame:?
		TX packets:20886594 errors:0 dropped:0 aborted:? carrier:?
		collisions:?
		RX bytes:0  TX bytes:1336741760 (1.2 GiB)
	port 2: dpdk0 (dpdk: configured_rx_queues=1, configured_rxq_descriptors=2048, configured_tx_queues=9, configured_txq_descriptors=2048, mtu=1500, requested_rx_queues=1, requested_rxq_descriptors=2048, requested_tx_queues=9, requested_txq_descriptors=2048, rx_csum_offload=true)
		RX packets:20886590 errors:0 dropped:9110911 overruns:? frame:?
		TX packets:4 errors:0 dropped:0 aborted:? carrier:?
		collisions:?
		RX bytes:1919840064 (1.8 GiB)  TX bytes:0
	port 3: ovsbr0 (tap)
		RX packets:825100 errors:0 dropped:15057203 overruns:0 frame:0
		TX packets:39133865 errors:0 dropped:0 aborted:0 carrier:0
		collisions:0
		RX bytes:1183348042 (1.1 GiB)  TX bytes:2506499244 (2.3 GiB)
Comment 15 errata-xmlrpc 2019-08-20 11:09:01 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2019:2529