2166881 – [16.2][OFFLOAD][OVN][VLAN TRUNK][CONNTRACK] Some flows are not offloaded

Bug 2166881 - [16.2][OFFLOAD][OVN][VLAN TRUNK][CONNTRACK] Some flows are not offloaded

Summary: [16.2][OFFLOAD][OVN][VLAN TRUNK][CONNTRACK] Some flows are not offloaded

Keywords:
Status:	NEW
Alias:	None
Product:	Red Hat OpenStack
Classification:	Red Hat
Component:	openvswitch
Sub Component:
Version:	16.2 (Train)
Hardware:	Unspecified
OS:	Unspecified
Priority:	unspecified
Severity:	medium
Target Milestone:	---
Target Release:	---
Assignee:	Marcelo Ricardo Leitner
QA Contact:	Eran Kuris
Docs Contact:
URL:
Whiteboard:
Depends On:
Blocks:	2172625
TreeView+	depends on / blocked

Reported:	2023-02-03 10:44 UTC by Miguel Angel Nieto
Modified:	2023-07-12 16:10 UTC (History)
CC List:	6 users (show)
Fixed In Version:
Doc Type:	If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:
Target Upstream Version:
Embargoed:

Attachments	(Terms of Use)

Links
System	ID	Private	Priority	Status	Summary	Last Updated
Red Hat Issue Tracker	NFV-2767	0	None	None	None	2023-02-13 15:40:10 UTC
Red Hat Issue Tracker	OSP-22027	0	None	None	None	2023-02-03 10:45:44 UTC

Description Miguel Angel Nieto 2023-02-03 10:44:21 UTC

Description of problem:
Not all flows for vlan trunk ports are offloaded when using security groups.
I have created 2 vms with a geneve port and a vlan trunk port whose parent is the previous one. Security groups are configured. 

For geneve port I get 39gps using iperf3 while with the vlan trunk i only get 19gps

I even see that security groups are not working with vlan trunk ports. If i send traffic using a different port than the configured in security groups, this traffic is not blocked as it happens in the geneve case.

Servers:
(overcloud) [stack@undercloud-0 ~]$ openstack server list --all-projects
+--------------------------------------+------------------------------------------+--------+------------------------------------------------------+---------------------------+--------------------+
| ID                                   | Name                                     | Status | Networks                                             | Image                     | Flavor             |
+--------------------------------------+------------------------------------------+--------+------------------------------------------------------+---------------------------+--------------------+
| 42daeb43-8e6f-42f7-a604-26e3c5da310a | tempest-TestNfvOffload-server-529174837  | ACTIVE | mellanox-geneve-provider=20.20.220.177, 10.10.149.64 | rhel-guest-image-8.7-1660 | nfv_qe_base_flavor |
| 5c1f9d04-2686-4730-8e34-0b83f4712807 | tempest-TestNfvOffload-server-2073333495 | ACTIVE | mellanox-geneve-provider=20.20.220.191, 10.10.149.65 | rhel-guest-image-8.7-1660 | nfv_qe_base_flavor |
+--------------------------------------+------------------------------------------+--------+------------------------------------------------------+---------------------------+--------------------+

Security group:
(overcloud) [stack@undercloud-0 ~]$ openstack security group show tempest-TestNfvOffload-664520908
+-----------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Field           | Value                                                                                                                                                                                                                |
+-----------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| created_at      | 2023-02-03T09:40:06Z                                                                                                                                                                                                 |
| description     | tempest-TestNfvOffload-664520908 description                                                                                                                                                                         |
| id              | 59a5ce14-ab61-47ee-a745-714aeb30bb9a                                                                                                                                                                                 |
| location        | cloud='', project.domain_id=, project.domain_name=, project.id='9580fc628d384221ab606bf9f8f4c32b', project.name=, region_name='regionOne', zone=                                                                     |
| name            | tempest-TestNfvOffload-664520908                                                                                                                                                                                     |
| project_id      | 9580fc628d384221ab606bf9f8f4c32b                                                                                                                                                                                     |
| revision_number | 5                                                                                                                                                                                                                    |
| rules           | created_at='2023-02-03T09:41:47Z', direction='ingress', ethertype='IPv4', id='4756947c-f429-43a5-9369-42342c3bfb8f', port_range_max='8594', port_range_min='8594', protocol='tcp', updated_at='2023-02-03T09:41:47Z' |
|                 | created_at='2023-02-03T09:41:47Z', direction='egress', ethertype='IPv4', id='4da4d3e2-84cc-40d2-bb5f-f13bddadc825', port_range_max='8594', port_range_min='8594', protocol='tcp', updated_at='2023-02-03T09:41:47Z'  |
|                 | created_at='2023-02-03T09:40:06Z', direction='egress', ethertype='IPv4', id='be9b6263-e7b5-4f94-b4de-f34c8f9b3cf9', updated_at='2023-02-03T09:40:06Z'                                                                |
|                 | created_at='2023-02-03T09:40:06Z', direction='ingress', ethertype='IPv4', id='c4107ab3-8317-49ef-b750-2e4d3f9d4024', port_range_max='22', port_range_min='22', protocol='tcp', updated_at='2023-02-03T09:40:06Z'     |
|                 | created_at='2023-02-03T09:40:06Z', direction='egress', ethertype='IPv6', id='c83204f2-0c43-41b2-99c4-084efce6fc11', updated_at='2023-02-03T09:40:06Z'                                                                |
|                 | created_at='2023-02-03T09:40:06Z', direction='ingress', ethertype='IPv4', id='f59aeb6e-2a50-44c3-9c31-396734602616', protocol='icmp', updated_at='2023-02-03T09:40:06Z'                                              |
| tags            | []                                                                                                                                                                                                                   |
| updated_at      | 2023-02-03T09:41:47Z                                                                                                                                                                                                 |
+-----------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

networks
(overcloud) [stack@undercloud-0 ~]$ openstack network list
+--------------------------------------+--------------------------+--------------------------------------+
| ID                                   | Name                     | Subnets                              |
+--------------------------------------+--------------------------+--------------------------------------+
| 7ca515cb-4a28-4209-9fb5-dddfd6a4d0a6 | trunk_network            | 78176c45-059a-4740-8767-d3955ddfaf4b |
| 93a65ead-237d-49bb-b1e9-f166ac847a78 | mellanox-geneve-provider | 36f93d15-eae8-4f5f-8ab8-46044e039bc4 |
| c10a2253-9407-4a79-88e6-f6cb420e3091 | internal-router-network  | 122640e0-97b4-45ad-ad6b-22486d2efa92 |
+--------------------------------------+--------------------------+--------------------------------------+


parent port:
(overcloud) [stack@undercloud-0 ~]$ openstack port show tempest-port-smoke-1017664855
+-------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Field                   | Value                                                                                                                                                                         |
+-------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| admin_state_up          | UP                                                                                                                                                                            |
| allowed_address_pairs   |                                                                                                                                                                               |
| binding_host_id         | computehwoffload-r740-0.redhat.local                                                                                                                                          |
| binding_profile         | capabilities='['switchdev']', pci_slot='0000:18:00.3', pci_vendor_info='15b3:1018', physical_network=                                                                         |
| binding_vif_details     | port_filter='True'                                                                                                                                                            |
| binding_vif_type        | ovs                                                                                                                                                                           |
| binding_vnic_type       | direct                                                                                                                                                                        |
| created_at              | 2023-02-03T09:40:08Z                                                                                                                                                          |
| data_plane_status       | None                                                                                                                                                                          |
| description             |                                                                                                                                                                               |
| device_id               | 42daeb43-8e6f-42f7-a604-26e3c5da310a                                                                                                                                          |
| device_owner            | compute:nova                                                                                                                                                                  |
| dns_assignment          | fqdn='host-20-20-220-177.openstacklocal.', hostname='host-20-20-220-177', ip_address='20.20.220.177'                                                                          |
| dns_domain              | None                                                                                                                                                                          |
| dns_name                |                                                                                                                                                                               |
| extra_dhcp_opts         |                                                                                                                                                                               |
| fixed_ips               | ip_address='20.20.220.177', subnet_id='36f93d15-eae8-4f5f-8ab8-46044e039bc4'                                                                                                  |
| id                      | 4ffcbff7-e318-4465-896c-f3c1ce937f32                                                                                                                                          |
| location                | cloud='', project.domain_id=, project.domain_name=, project.id='9580fc628d384221ab606bf9f8f4c32b', project.name=, region_name='regionOne', zone=                              |
| mac_address             | fa:16:3e:09:44:82                                                                                                                                                             |
| name                    | tempest-port-smoke-1017664855                                                                                                                                                 |
| network_id              | 93a65ead-237d-49bb-b1e9-f166ac847a78                                                                                                                                          |
| port_security_enabled   | True                                                                                                                                                                          |
| project_id              | 9580fc628d384221ab606bf9f8f4c32b                                                                                                                                              |
| propagate_uplink_status | None                                                                                                                                                                          |
| qos_policy_id           | None                                                                                                                                                                          |
| resource_request        | None                                                                                                                                                                          |
| revision_number         | 4                                                                                                                                                                             |
| security_group_ids      | 59a5ce14-ab61-47ee-a745-714aeb30bb9a                                                                                                                                          |
| status                  | ACTIVE                                                                                                                                                                        |
| tags                    |                                                                                                                                                                               |
| trunk_details           | {'trunk_id': '78873145-98de-4c82-aa33-3ee80c4b624d', 'sub_ports': [{'segmentation_id': 147, 'segmentation_type': 'vlan', 'port_id': 'f14e0867-9039-48b0-aa1c-81c758883951'}]} |
| updated_at              | 2023-02-03T09:40:32Z                                                                                                                                                          |
+-------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

vlan trunk port
(overcloud) [stack@undercloud-0 ~]$ openstack port show f14e0867-9039-48b0-aa1c-81c758883951
+-------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------+
| Field                   | Value                                                                                                                                            |
+-------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------+
| admin_state_up          | UP                                                                                                                                               |
| allowed_address_pairs   |                                                                                                                                                  |
| binding_host_id         |                                                                                                                                                  |
| binding_profile         | parent_name='4ffcbff7-e318-4465-896c-f3c1ce937f32', tag='147'                                                                                    |
| binding_vif_details     |                                                                                                                                                  |
| binding_vif_type        | ovs                                                                                                                                              |
| binding_vnic_type       | normal                                                                                                                                           |
| created_at              | 2023-02-03T09:40:10Z                                                                                                                             |
| data_plane_status       | None                                                                                                                                             |
| description             |                                                                                                                                                  |
| device_id               |                                                                                                                                                  |
| device_owner            | trunk:subport                                                                                                                                    |
| dns_assignment          | fqdn='host-50-50-220-199.openstacklocal.', hostname='host-50-50-220-199', ip_address='50.50.220.199'                                             |
| dns_domain              | None                                                                                                                                             |
| dns_name                |                                                                                                                                                  |
| extra_dhcp_opts         |                                                                                                                                                  |
| fixed_ips               | ip_address='50.50.220.199', subnet_id='78176c45-059a-4740-8767-d3955ddfaf4b'                                                                     |
| id                      | f14e0867-9039-48b0-aa1c-81c758883951                                                                                                             |
| location                | cloud='', project.domain_id=, project.domain_name=, project.id='9580fc628d384221ab606bf9f8f4c32b', project.name=, region_name='regionOne', zone= |
| mac_address             | fa:16:3e:9c:09:20                                                                                                                                |
| name                    | tempest-port-smoke-1730120351                                                                                                                    |
| network_id              | 7ca515cb-4a28-4209-9fb5-dddfd6a4d0a6                                                                                                             |
| port_security_enabled   | True                                                                                                                                             |
| project_id              | 9580fc628d384221ab606bf9f8f4c32b                                                                                                                 |
| propagate_uplink_status | None                                                                                                                                             |
| qos_policy_id           | None                                                                                                                                             |
| resource_request        | None                                                                                                                                             |
| revision_number         | 3                                                                                                                                                |
| security_group_ids      | 7bd1df4a-569b-43fc-a31c-3a887ddd68ba                                                                                                             |
| status                  | ACTIVE                                                                                                                                           |
| tags                    |                                                                                                                                                  |
| trunk_details           | None                                                                                                                                             |
| updated_at              | 2023-02-03T09:40:32Z                                                                                                                             |
+-------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------+

iperf commands:
iperf3 -s -B 50.50.220.193 -p 8594
iperf3 -c 50.50.220.193 -T s2 -p 8594 -t  84600


Flows. Only 1 flow is offloaded, not the other one
ufid:eac788ef-0d53-4391-97e5-066a90c56134, skb_priority(0/0),skb_mark(0/0),ct_state(0x2a/0x3e),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x1421),dp_hash(0/0),in_port(enp4s0f0_3),packet_type(ns=0/0,id=0/0),eth(src=fa:16:3e:5f:e3:16,dst=fa:16:3e:9c:09:20),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=50.50.220.192/255.255.255.224,proto=0/0,tos=0/0,ttl=0/0,frag=no), packets:502051, bytes:26106664, used:0.000s, offloaded:yes, dp:tc, actions:push_vlan(vid=147,pcp=0),mx-bond
ufid:b6fc2f5e-0364-46eb-971e-b8eb6b5a7963, skb_priority(0/0),skb_mark(0/0),ct_state(0x22/0x3e),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x1420),dp_hash(0/0),in_port(mx-bond),packet_type(ns=0/0,id=0/0),eth(src=fa:16:3e:9c:09:20,dst=fa:16:3e:5f:e3:16),eth_type(0x0800),ipv4(src=50.50.220.199,dst=50.50.220.193,proto=0/0,tos=0/0,ttl=0/0,frag=no), packets:7516854, bytes:67239611097, used:0.180s, offloaded:yes, dp:tc, actions:push_vlan(vid=147,pcp=0),enp4s0f0_3


conntrack table
[root@computehwoffload-r730-0 heat-admin]# sudo cat /proc/net/nf_conntrack | grep 50.50
ipv4     2 tcp      6 431910 ESTABLISHED src=50.50.220.199 dst=50.50.220.193 sport=41176 dport=8594 src=50.50.220.193 dst=50.50.220.199 sport=8594 dport=41176 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=7 use=2
ipv4     2 tcp      6 src=50.50.220.199 dst=50.50.220.193 sport=41184 dport=8594 src=50.50.220.193 dst=50.50.220.199 sport=8594 dport=41184 [HW_OFFLOAD] mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=7 use=3

packets can be in representor port (they are not offloaded)
[root@computehwoffload-r730-0 heat-admin]# tcpdump -i enp4s0f0_3 -nne | head -20
dropped privs to tcpdump
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on enp4s0f0_3, link-type EN10MB (Ethernet), capture size 262144 bytes
10:40:40.439303 fa:16:3e:5f:e3:16 > fa:16:3e:9c:09:20, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.193.8594 > 50.50.220.199.41184: Flags [.], ack 815385237, win 24186, options [nop,nop,TS val 880857171 ecr 3323272578], length 0
10:40:40.439324 fa:16:3e:5f:e3:16 > fa:16:3e:9c:09:20, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.193.8594 > 50.50.220.199.41184: Flags [.], ack 62231, win 24303, options [nop,nop,TS val 880857171 ecr 3323272578], length 0
10:40:40.439360 fa:16:3e:5f:e3:16 > fa:16:3e:9c:09:20, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.193.8594 > 50.50.220.199.41184: Flags [.], ack 168911, win 24381, options [nop,nop,TS val 880857171 ecr 3323272578], length 0
10:40:40.439438 fa:16:3e:5f:e3:16 > fa:16:3e:9c:09:20, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.193.8594 > 50.50.220.199.41184: Flags [.], ack 275591, win 24566, options [nop,nop,TS val 880857172 ecr 3323272578], length 0
10:40:40.439507 fa:16:3e:5f:e3:16 > fa:16:3e:9c:09:20, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.193.8594 > 50.50.220.199.41184: Flags [.], ack 497841, win 24147, options [nop,nop,TS val 880857172 ecr 3323272578], length 0
10:40:40.439552 fa:16:3e:5f:e3:16 > fa:16:3e:9c:09:20, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.193.8594 > 50.50.220.199.41184: Flags [.], ack 675641, win 23796, options [nop,nop,TS val 880857172 ecr 3323272578], length 0
10:40:40.439608 fa:16:3e:5f:e3:16 > fa:16:3e:9c:09:20, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.193.8594 > 50.50.220.199.41184: Flags [.], ack 693421, win 24498, options [nop,nop,TS val 880857172 ecr 3323272578], length 0
10:40:40.439642 fa:16:3e:5f:e3:16 > fa:16:3e:9c:09:20, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.193.8594 > 50.50.220.199.41184: Flags [.], ack 808991, win 24342, options [nop,nop,TS val 880857172 ecr 3323272579], length 0
10:40:40.439676 fa:16:3e:5f:e3:16 > fa:16:3e:9c:09:20, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.193.8594 > 50.50.220.199.41184: Flags [.], ack 853441, win 24381, options [nop,nop,TS val 880857172 ecr 3323272579], length 0
10:40:40.439711 fa:16:3e:5f:e3:16 > fa:16:3e:9c:09:20, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.193.8594 > 50.50.220.199.41184: Flags [.], ack 977901, win 24303, options [nop,nop,TS val 880857172 ecr 3323272579], length 0
10:40:40.439740 fa:16:3e:5f:e3:16 > fa:16:3e:9c:09:20, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.193.8594 > 50.50.220.199.41184: Flags [.], ack 1040131, win 24303, options [nop,nop,TS val 880857172 ecr 3323272579], length 0
10:40:40.439777 fa:16:3e:5f:e3:16 > fa:16:3e:9c:09:20, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.193.8594 > 50.50.220.199.41184: Flags [.], ack 1111251, win 24537, options [nop,nop,TS val 880857172 ecr 3323272579], length 0
10:40:40.439850 fa:16:3e:5f:e3:16 > fa:16:3e:9c:09:20, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.193.8594 > 50.50.220.199.41184: Flags [.], ack 1289051, win 24342, options [nop,nop,TS val 880857172 ecr 3323272579], length 0
10:40:40.439910 fa:16:3e:5f:e3:16 > fa:16:3e:9c:09:20, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.193.8594 > 50.50.220.199.41184: Flags [.], ack 1413511, win 24566, options [nop,nop,TS val 880857172 ecr 3323272579], length 0
10:40:40.439983 fa:16:3e:5f:e3:16 > fa:16:3e:9c:09:20, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.193.8594 > 50.50.220.199.41184: Flags [.], ack 1617981, win 24225, options [nop,nop,TS val 880857172 ecr 3323272579], length 0
10:40:40.440008 fa:16:3e:5f:e3:16 > fa:16:3e:9c:09:20, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.193.8594 > 50.50.220.199.41184: Flags [.], ack 1680211, win 24303, options [nop,nop,TS val 880857172 ecr 3323272579], length 0
10:40:40.440045 fa:16:3e:5f:e3:16 > fa:16:3e:9c:09:20, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.193.8594 > 50.50.220.199.41184: Flags [.], ack 1795781, win 24342, options [nop,nop,TS val 880857172 ecr 3323272579], length 0
10:40:40.440097 fa:16:3e:5f:e3:16 > fa:16:3e:9c:09:20, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.193.8594 > 50.50.220.199.41184: Flags [.], ack 1858011, win 24566, options [nop,nop,TS val 880857172 ecr 3323272579], length 0
10:40:40.440185 fa:16:3e:5f:e3:16 > fa:16:3e:9c:09:20, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.193.8594 > 50.50.220.199.41184: Flags [.], ack 2044701, win 24303, options [nop,nop,TS val 880857172 ecr 3323272579], length 0
10:40:40.440213 fa:16:3e:5f:e3:16 > fa:16:3e:9c:09:20, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.193.8594 > 50.50.220.199.41184: Flags [.], ack 2106931, win 24303, options [nop,nop,TS val 880857172 ecr 3323272579], length 0







Version-Release number of selected component (if applicable):
RHOS-16.2-RHEL-8-20221201.n.1

How reproducible:
Deploy 16.2 ovn offload templates (I used ospd-16.2-geneve-ovn-dvr-hw-offload-ctlplane-dataplane-bonding-hybrid)
Create a vm with 1 geneve interface and a vlan trunk
Inject tcp traffic
Check if traffic is offloaded

Actual results:
Traffic not offloaded


Expected results:
Traffic should be offloaded

Additional info:

Comment 1 Flavio Leitner 2023-02-03 11:13:03 UTC

Hi,

Can you provide more details about the mx-bond interface?
Is it an OVS bond? Kernel bond? Which mode?

Thanks,
fbl

Comment 5 Miguel Angel Nieto 2023-02-03 13:46:46 UTC

I connected to a wrong setup, sorry.

This is the information about the bond:

    Bridge br-link0
        fail_mode: standalone
        Port mx-bond
            Interface mx-bond
        Port br-link0
            Interface br-link0
                type: internal
        Port patch-provnet-f73c86b8-16d3-463b-ae36-3bb96765baf2-to-br-int
            Interface patch-provnet-f73c86b8-16d3-463b-ae36-3bb96765baf2-to-br-int
                type: patch
                options: {peer=patch-br-int-to-provnet-f73c86b8-16d3-463b-ae36-3bb96765baf2}
        Port vlan145
            tag: 145
            Interface vlan145
                type: internal
        Port patch-provnet-c48edaa2-a01c-4d92-b409-951c71f864de-to-br-int
            Interface patch-provnet-c48edaa2-a01c-4d92-b409-951c71f864de-to-br-int
                type: patch
                options: {peer=patch-br-int-to-provnet-c48edaa2-a01c-4d92-b409-951c71f864de}


[root@computehwoffload-r730-0 heat-admin]# cat  /proc/net/bonding/mx-bond
Ethernet Channel Bonding Driver: v4.18.0-305.65.1.el8_4.x86_64

Bonding Mode: fault-tolerance (active-backup)
Primary Slave: None
Currently Active Slave: enp4s0f0
MII Status: up
MII Polling Interval (ms): 0
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: enp4s0f0
MII Status: up
Speed: 40000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: ec:0d:9a:7d:7d:2a
Slave queue ID: 0

Slave Interface: enp4s0f1
MII Status: up
Speed: 40000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: ec:0d:9a:7d:7d:2b
Slave queue ID: 0

32: enp4s0f0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master mx-bond state UP mode DEFAULT group default qlen 1000
    link/ether ec:0d:9a:7d:7d:2a brd ff:ff:ff:ff:ff:ff
    vf 0     link/ether 26:94:f7:b8:c2:40 brd ff:ff:ff:ff:ff:ff, spoof checking off, link-state disable, trust off, query_rss off
    vf 1     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking off, link-state disable, trust off, query_rss off
    vf 2     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking off, link-state disable, trust off, query_rss off
    vf 3     link/ether fa:16:3e:27:73:e6 brd ff:ff:ff:ff:ff:ff, spoof checking off, link-state disable, trust off, query_rss off
    vf 4     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking off, link-state disable, trust off, query_rss off
    vf 5     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking off, link-state disable, trust off, query_rss off
    vf 6     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking off, link-state disable, trust off, query_rss off
    vf 7     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking off, link-state disable, trust off, query_rss off
    vf 8     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking off, link-state disable, trust off, query_rss off
    vf 9     link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff, spoof checking off, link-state disable, trust off, query_rss off

Comment 10 Miguel Angel Nieto 2023-02-23 16:07:08 UTC

Some data from the test:

*******************************************
VMS
********************************************
overcloud) [stack@undercloud-0 ~]$ openstack server list --all-projects
+--------------------------------------+------------------------------------------+--------+------------------------------------------------------+----------------------------------------+--------------------+
| ID                                   | Name                                     | Status | Networks                                             | Image                                  | Flavor             |
+--------------------------------------+------------------------------------------+--------+------------------------------------------------------+----------------------------------------+--------------------+
| a4c147b7-cfff-4f4a-9e02-33399c3756f6 | tempest-TestNfvOffload-server-1486435327 | ACTIVE | mellanox-geneve-provider=20.20.220.189, 10.10.149.55 | rhel-guest-image-8.7-1660.x86_64.qcow2 | nfv_qe_base_flavor |
| 1774bee8-9a41-4858-b144-c26aeb5084b7 | tempest-TestNfvOffload-server-909491867  | ACTIVE | mellanox-geneve-provider=20.20.220.175, 10.10.149.51 | rhel-guest-image-8.7-1660.x86_64.qcow2 | nfv_qe_base_flavor |
+--------------------------------------+------------------------------------------+--------+------------------------------------------------------+----------------------------------------+--------------------+

*******************************************
VMS INTERFACES
********************************************
[cloud-user@tempest-testnfvoffload-server-1486435327 ~]$ ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 8942 qdisc mq state UP group default qlen 1000
    link/ether fa:16:3e:4a:98:c2 brd ff:ff:ff:ff:ff:ff
    altname enp0s4
    altname ens4
    inet 20.20.220.189/24 brd 20.20.220.255 scope global dynamic noprefixroute eth0
       valid_lft 41507sec preferred_lft 41507sec
    inet6 fe80::f816:3eff:fe4a:98c2/64 scope link 
       valid_lft forever preferred_lft forever
3: eth0.147@eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 8942 qdisc noqueue state UP group default qlen 1000
    link/ether fa:16:3e:df:59:67 brd ff:ff:ff:ff:ff:ff
    inet 50.50.220.179/24 scope global eth0.147
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fedf:5967/64 scope link 
       valid_lft forever preferred_lft forever

[cloud-user@tempest-testnfvoffload-server-909491867 ~]$ ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 8942 qdisc mq state UP group default qlen 1000
    link/ether fa:16:3e:ed:d6:5b brd ff:ff:ff:ff:ff:ff
    altname enp0s4
    altname ens4
    inet 20.20.220.175/24 brd 20.20.220.255 scope global dynamic noprefixroute eth0
       valid_lft 41492sec preferred_lft 41492sec
    inet6 fe80::f816:3eff:feed:d65b/64 scope link 
       valid_lft forever preferred_lft forever
3: eth0.147@eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 8942 qdisc noqueue state UP group default qlen 1000
    link/ether fa:16:3e:5f:da:b4 brd ff:ff:ff:ff:ff:ff
    inet 50.50.220.126/24 scope global eth0.147
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fe5f:dab4/64 scope link 
       valid_lft forever preferred_lft forever

*******************************************
IPERF commands
********************************************
[cloud-user@tempest-testnfvoffload-server-1486435327 ~]$ ps -ef | grep iperf
cloud-u+   14352       1 28 10:42 ?        00:01:46 iperf3 -c 50.50.220.126 -T s2 -p 8154 -t 84600
[cloud-user@tempest-testnfvoffload-server-909491867 ~]$ ps -ef | grep iperf
cloud-u+   14296       1 31 10:41 ?        00:02:06 iperf3 -s -B 50.50.220.126 -p 8154



*******************************************
FLOWS
********************************************
[root@computehwoffload-r730-0 heat-admin]# ovs-appctl dpctl/dump-flows -m                                                                                                                                          
ufid:9419efeb-4672-4a9c-8a89-299e27adf726, skb_priority(0/0),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),recirc_id(0),dp_hash(0/0),in_port(enp4s0f0_3),packet_type(ns=0/0,id=0/0),eth(src=$
a:16:3e:5f:da:b4,dst=fa:16:3e:df:59:67),eth_type(0x8100),vlan(vid=147,pcp=0),encap(eth_type(0x0800),ipv4(src=50.50.220.126,dst=50.50.220.128/255.255.255.192,proto=6,tos=0/0,ttl=0/0,frag=no),tcp(src=0/0,dst=0/0)$
, packets:1616759, bytes:84071524, used:0.000s, dp:tc, actions:pop_vlan,ct(zone=8),recirc(0x4f9)                                                                                                                   
ufid:9131db58-4c6b-4073-a922-e3b28389209e, skb_priority(0/0),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),recirc_id(0),dp_hash(0/0),in_port(enp4s0f0_3),packet_type(ns=0/0,id=0/0),eth(src=$
a:16:3e:ed:d6:5b,dst=fa:16:3e:b8:d1:ab),eth_type(0x0800),ipv4(src=20.20.220.175,dst=0.0.0.0/240.0.0.0,proto=6,tos=0/0,ttl=0/0,frag=no),tcp(src=0/0,dst=0/0), packets:84, bytes:13435, used:0.740s, offloaded:yes, $
p:tc, actions:ct(zone=10),recirc(0x507)                                                                                                                                                                            
ufid:eae05658-59d5-440f-83b0-42db2a303eb9, skb_priority(0/0),skb_mark(0/0),ct_state(0x2a/0x3e),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x4f9),dp_hash(0/0),in_port(enp4s0f0_3),packet_type(ns=0/0,id=0$
0),eth(src=fa:16:3e:5f:da:b4,dst=fa:16:3e:df:59:67),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=50.50.220.128/255.255.255.192,proto=0/0,tos=0/0,ttl=0/0,frag=no), packets:1616759, bytes:84071524, used:0.000s, $
ffloaded:yes, dp:tc, actions:push_vlan(vid=147,pcp=0),mx-bond                                                                                                                                                      
ufid:51e39475-179f-433e-afb8-90a39e92e798, skb_priority(0/0),skb_mark(0/0),ct_state(0x2a/0x3e),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x507),dp_hash(0/0),in_port(enp4s0f0_3),packet_type(ns=0/0,id=0$
0),eth(src=fa:16:3e:ed:d6:5b,dst=fa:16:3e:b8:d1:ab),eth_type(0x0800),ipv4(src=20.20.220.175,dst=10.10.149.1,proto=6,tos=0/0,ttl=64,frag=no),tcp(src=0/0,dst=0/0), packets:83, bytes:13355, used:0.740s, offloaded:y
es, dp:tc, actions:ct_clear,set(eth(src=fa:16:3e:c7:e7:69,dst=52:54:00:06:67:54)),set(ipv4(ttl=63)),ct(zone=2,nat),recirc(0x508)                                                                                   
ufid:b78b65c4-19d5-4e9c-8f89-b9407013656f, skb_priority(0/0),skb_mark(0/0),ct_state(0x2a/0x3e),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x508),dp_hash(0/0),in_port(enp4s0f0_3),packet_type(ns=0/0,id=0/
0),eth(src=fa:16:3e:c7:e7:69,dst=52:54:00:06:67:54),eth_type(0x0800),ipv4(src=0.0.0.0/240.0.0.0,dst=10.10.149.0/255.255.255.224,proto=0/0,tos=0/0,ttl=0/0,frag=no), packets:83, bytes:13667, used:0.740s, offloaded
:yes, dp:tc, actions:ct_clear,push_vlan(vid=149,pcp=0),mx-bond                                                                                                                                                     
ufid:b35d8227-84fe-4e81-a33d-1c80d32cd939, skb_priority(0/0),skb_mark(0/0),ct_state(0x22/0x3e),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x4f8),dp_hash(0/0),in_port(mx-bond),packet_type(ns=0/0,id=0/0),

eth(src=fa:16:3e:df:59:67,dst=fa:16:3e:5f:da:b4),eth_type(0x0800),ipv4(src=50.50.220.179,dst=50.50.220.126,proto=0/0,tos=0/0,ttl=0/0,frag=no), packets:41583630, bytes:371951351904, used:0.740s, offloaded:yes, dp
:tc, actions:push_vlan(vid=147,pcp=0),enp4s0f0_3  
ufid:07b2e6fa-6537-4f91-9d02-f4bb3bbef598, skb_priority(0/0),skb_mark(0/0),ct_state(0/0x3f),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0),dp_hash(0/0),in_port(mx-bond),packet_type(ns=0/0,id=0/0),e[4/75]
=fa:16:3e:df:59:67,dst=fa:16:3e:5f:da:b4),eth_type(0x8100),vlan(vid=147,pcp=0),encap(eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=0.0.0.0/0.0.0.0,proto=6,tos=0/0,ttl=0/0,frag=no),tcp(src=0/0,dst=0/0)), packets:
41583632, bytes:371951352024, used:0.740s, offloaded:yes, dp:tc, actions:pop_vlan,ct(zone=8),recirc(0x4f8)                                                                                                         
ufid:b304f561-9f5b-4ba7-b4ca-5228f962e270, skb_priority(0/0),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),recirc_id(0),dp_hash(0/0),in_port(mx-bond),packet_type(ns=0/0,id=0/0),eth(src=52:5
4:00:06:67:54,dst=fa:16:3e:c7:e7:69),eth_type(0x8100),vlan(vid=149,pcp=0),encap(eth_type(0x0800),ipv4(src=10.10.149.0/255.255.255.192,dst=10.10.149.51,proto=6,tos=0/0,ttl=64,frag=no),tcp(src=0/0,dst=0/0)), packe
ts:109, bytes:15277, used:0.740s, offloaded:yes, dp:tc, actions:pop_vlan,ct(zone=2,nat),recirc(0x504)
ufid:bd6f954a-3179-487f-be80-423a49241b9d, skb_priority(0/0),skb_mark(0/0),ct_state(0x22/0x3e),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x504),dp_hash(0/0),in_port(mx-bond),packet_type(ns=0/0,id=0/0),
eth(src=52:54:00:06:67:54,dst=fa:16:3e:c7:e7:69),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=20.20.220.175,proto=6,tos=0/0,ttl=64,frag=no),tcp(src=0/0,dst=0/0), packets:106, bytes:15091, used:0.740s, offloaded
:yes, dp:tc, actions:ct_clear,set(eth(src=fa:16:3e:b8:d1:ab,dst=fa:16:3e:ed:d6:5b)),set(ipv4(ttl=63)),ct(zone=10),recirc(0x506)
ufid:c30fd565-7cc2-4d1e-88bd-8079873c9833, skb_priority(0/0),skb_mark(0/0),ct_state(0x22/0x3e),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x506),dp_hash(0/0),in_port(mx-bond),packet_type(ns=0/0,id=0/0),
eth(src=fa:16:3e:b8:d1:ab,dst=fa:16:3e:ed:d6:5b),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=20.20.220.175,proto=6,tos=0/0,ttl=0/0,frag=no),tcp(src=0/0,dst=22), packets:134, bytes:21653, used:0.740s, offloaded
:yes, dp:tc, actions:enp4s0f0_3
ufid:36c1c587-33e9-47cb-866b-d6b01cdb4596, recirc_id(0),dp_hash(0/0),skb_priority(0/0),tunnel(tun_id=0x0,src=10.10.141.114,dst=10.10.141.104,ttl=0/0,flags(-df+csum+key)),in_port(genev_sys_6081),skb_mark(0/0),ct_
state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=7a:69:20:43:be:a1,dst=00:00:00:00:00:00/00:00:00:00:00:00),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=0.0.0.0/0.0.0.0,proto=17,tos=0/0,ttl=0/0,frag=n
o),udp(src=0/0,dst=3784), packets:8809, bytes:581394, used:0.472s, dp:ovs, actions:userspace(pid=3460822224,slow_path(bfd))
ufid:f4b40059-27ce-47d1-bcac-e6718ee8290a, recirc_id(0),dp_hash(0/0),skb_priority(0/0),tunnel(tun_id=0x0,src=10.10.141.123,dst=10.10.141.104,ttl=0/0,flags(-df+csum+key)),in_port(genev_sys_6081),skb_mark(0/0),ct_
state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=76:03:da:26:cf:95,dst=00:00:00:00:00:00/00:00:00:00:00:00),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=0.0.0.0/0.0.0.0,proto=17,tos=0/0,ttl=0/0,frag=n
o),udp(src=0/0,dst=3784), packets:8809, bytes:581394, used:0.645s, dp:ovs, actions:userspace(pid=3460822224,slow_path(bfd))
ufid:ec142fda-a8eb-40f6-839c-fa76c8cf4dd1, recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(mx-bond),skb_mark(0/0),ct_state(0/0x3f),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),eth(src=52:54:00:06:67:54,dst=fa:1
6:3e:c7:e7:69),eth_type(0x8100),vlan(vid=149,pcp=0/0x0),encap(eth_type(0x0806),arp(sip=10.10.149.1,tip=10.10.149.51,op=1/0xff,sha=52:54:00:06:67:54,tha=00:00:00:00:00:00)), packets:0, bytes:0, used:never, dp:ovs
, actions:userspace(pid=4110685688,slow_path(action))
ufid:a60a1525-4f71-45e5-89c2-4b43a72a0337, recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(mx-bond),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=f4:52:14:25:28:74,dst=01:80:c2:
00:00:00),eth_type(0/0xffff), packets:11083, bytes:664980, used:0.538s, dp:ovs, actions:drop
ufid:18890527-d488-4843-b3e8-c7e66f289ce1, recirc_id(0),dp_hash(0/0),skb_priority(0/0),tunnel(tun_id=0x0,src=10.10.141.159,dst=10.10.141.104,ttl=0/0,flags(-df+csum+key)),in_port(genev_sys_6081),skb_mark(0/0),ct_
state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=fa:53:f4:38:7e:3d,dst=00:00:00:00:00:00/00:00:00:00:00:00),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=0.0.0.0/0.0.0.0,proto=17,tos=0/0,ttl=0/0,frag=n
o),udp(src=0/0,dst=3784), packets:8816, bytes:581856, used:0.521s, dp:ovs, actions:userspace(pid=3460822224,slow_path(bfd))
ufid:858793e1-c009-4aa9-9f5c-daea4156123d, recirc_id(0),dp_hash(0/0),skb_priority(0/0),tunnel(tun_id=0x0,src=10.10.141.120,dst=10.10.141.104,ttl=0/0,flags(-df+csum+key)),in_port(genev_sys_6081),skb_mark(0/0),ct_
state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=86:75:bf:96:80:99,dst=00:00:00:00:00:00/00:00:00:00:00:00),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=0.0.0.0/0.0.0.0,proto=17,tos=0/0,ttl=0/0,frag=n
o),udp(src=0/0,dst=3784), packets:8797, bytes:580602, used:0.356s, dp:ovs, actions:userspace(pid=3460822224,slow_path(bfd))






[root@computehwoffload-r740-0 heat-admin]# ovs-appctl dpctl/dump-flows -m                                                                                                                                          
ufid:f3d94270-d82e-4d3c-92a8-bfe10db64c57, skb_priority(0/0),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),recirc_id(0),dp_hash(0/0),in_port(mx-bond),packet_type(ns=0/0,id=0/0),eth(src=52:5
4:00:06:67:54,dst=fa:16:3e:eb:d3:05),eth_type(0x8100),vlan(vid=149,pcp=0),encap(eth_type(0x0800),ipv4(src=128.0.0.0/192.0.0.0,dst=10.10.149.55,proto=17,tos=0/0,ttl=51,frag=no),udp(src=0/0,dst=0/0)), packets:1, b
ytes:76, used:2.670s, offloaded:yes, dp:tc, actions:pop_vlan,ct(zone=2,nat),recirc(0x48e)                                                                                                                          
ufid:2752adfd-a8dd-43e5-95c7-c273bf2e31ab, skb_priority(0/0),skb_mark(0/0),ct_state(0/0x3f),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0),dp_hash(0/0),in_port(mx-bond),packet_type(ns=0/0,id=0/0),eth(src
=fa:16:3e:5f:da:b4,dst=fa:16:3e:df:59:67),eth_type(0x8100),vlan(vid=147,pcp=0),encap(eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=0.0.0.0/0.0.0.0,proto=6,tos=0/0,ttl=0/0,frag=no),tcp(src=0/0,dst=0/0)), packets:
1577496, bytes:104114736, used:0.390s, offloaded:yes, dp:tc, actions:pop_vlan,ct(zone=9),recirc(0x48a)                                                                                                             
ufid:601f644b-f9d5-4457-9e13-0cb4389f268b, skb_priority(0/0),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),recirc_id(0),dp_hash(0/0),in_port(mx-bond),packet_type(ns=0/0,id=0/0),eth(src=52:5
4:00:06:67:54,dst=fa:16:3e:eb:d3:05),eth_type(0x8100),vlan(vid=149,pcp=0),encap(eth_type(0x0800),ipv4(src=10.10.149.0/255.255.255.192,dst=10.10.149.55,proto=6,tos=0/0,ttl=64,frag=no),tcp(src=0/0,dst=0/0)), packe
ts:101, bytes:12338, used:1.410s, offloaded:yes, dp:tc, actions:pop_vlan,ct(zone=2,nat),recirc(0x48e)                                                                                                              
ufid:368db2cd-870f-44f0-8a92-4a1bcc909489, skb_priority(0/0),skb_mark(0/0),ct_state(0x2a/0x3e),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x48a),dp_hash(0/0),in_port(mx-bond),packet_type(ns=0/0,id=0/0),
eth(src=00:00:00:00:00:00/00:00:00:00:00:00,dst=fa:16:3e:df:59:67),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=50.50.220.179,proto=0/0,tos=0/0,ttl=0/0,frag=no), packets:1577496, bytes:104114736, used:0.390s, o
ffloaded:yes, dp:tc, actions:push_vlan(vid=147,pcp=0),ens6f0_1                                                                                                                                                     
ufid:72dfd5d5-ad08-415d-b015-ca53b6f1a23f, skb_priority(0/0),skb_mark(0/0),ct_state(0x2a/0x3e),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x48e),dp_hash(0/0),in_port(mx-bond),packet_type(ns=0/0,id=0/0),
eth(src=52:54:00:06:67:54,dst=fa:16:3e:eb:d3:05),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=20.20.220.189,proto=17,tos=0/0,ttl=51,frag=no),udp(src=0/0xfe00,dst=0/0), packets:1, bytes:76, used:2.670s, offloade
d:yes, dp:tc, actions:ct_clear,set(eth(src=fa:16:3e:b8:d1:ab,dst=fa:16:3e:4a:98:c2)),set(ipv4(ttl=50)),ct(zone=5),recirc(0x48f)                                                                                    
ufid:c69839fa-0bc7-4fed-aedf-cf15566e197d, skb_priority(0/0),skb_mark(0/0),ct_state(0x22/0x3e),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x48e),dp_hash(0/0),in_port(mx-bond),packet_type(ns=0/0,id=0/0),
eth(src=52:54:00:06:67:54,dst=fa:16:3e:eb:d3:05),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=20.20.220.189,proto=6,tos=0/0,ttl=64,frag=no),tcp(src=0/0,dst=0/0), packets:99, bytes:12212, used:1.410s, offloaded:
yes, dp:tc, actions:ct_clear,set(eth(src=fa:16:3e:b8:d1:ab,dst=fa:16:3e:4a:98:c2)),set(ipv4(ttl=63)),ct(zone=5),recirc(0x48f)                                                                                      
ufid:b3d1d6b3-a169-4505-93ed-ebdce9602e04, skb_priority(0/0),skb_mark(0/0),ct_state(0x2a/0x3e),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x48f),dp_hash(0/0),in_port(mx-bond),packet_type(ns=0/0,id=0/0),
eth(src=00:00:00:00:00:00/00:00:00:00:00:00,dst=fa:16:3e:4a:98:c2),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=20.20.220.189,proto=0/0,tos=0/0,ttl=0/0,frag=no), packets:1, bytes:76, used:2.670s, offloaded:yes,
 dp:tc, actions:ens6f0_1  
ufid:54640365-a738-42b2-a140-6dafc9efcfad, skb_priority(0/0),skb_mark(0/0),ct_state(0x22/0x3e),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x48f),dp_hash(0/0),in_port(mx-bond),packet_type(ns=0/0,i[23/62]
eth(src=fa:16:3e:b8:d1:ab,dst=fa:16:3e:4a:98:c2),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=20.20.220.189,proto=6,tos=0/0,ttl=0/0,frag=no),tcp(src=0/0,dst=22), packets:99, bytes:12212, used:1.410s, offloaded:
yes, dp:tc, actions:ens6f0_1                                                                                                                                                                                       
ufid:90cfd4cf-fb0d-4ea8-9d3f-41f3b13b94c9, skb_priority(0/0),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),recirc_id(0),dp_hash(0/0),in_port(ens6f0_1),packet_type(ns=0/0,id=0/0),eth(src=fa:
16:3e:df:59:67,dst=fa:16:3e:5f:da:b4),eth_type(0x8100),vlan(vid=147,pcp=0),encap(eth_type(0x0800),ipv4(src=50.50.220.179,dst=0.0.0.0/0.0.0.0,proto=6,tos=0/0,ttl=0/0,frag=no),tcp(src=0/0,dst=0/0)), packets:402592
20, bytes:357750246850, used:0.000s, dp:tc, actions:pop_vlan,ct(zone=9),recirc(0x489)
ufid:4c33fa87-615b-4f89-98a6-94f66d681a27, skb_priority(0/0),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),recirc_id(0),dp_hash(0/0),in_port(ens6f0_1),packet_type(ns=0/0,id=0/0),eth(src=fa:
16:3e:4a:98:c2,dst=fa:16:3e:b8:d1:ab),eth_type(0x0800),ipv4(src=20.20.220.189,dst=0.0.0.0/0.0.0.0,proto=17,tos=0/0,ttl=0/0,frag=no),udp(src=32768/0x8000,dst=0/0), packets:1, bytes:76, used:2.730s, offloaded:yes,
 dp:tc, actions:ct(zone=5),recirc(0x48b)
ufid:c4662cd5-2427-43d7-bb38-35a1b3e65d00, skb_priority(0/0),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),recirc_id(0),dp_hash(0/0),in_port(ens6f0_1),packet_type(ns=0/0,id=0/0),eth(src=fa:
16:3e:4a:98:c2,dst=fa:16:3e:b8:d1:ab),eth_type(0x0800),ipv4(src=20.20.220.189,dst=0.0.0.0/0.0.0.0,proto=6,tos=0/0,ttl=0/0,frag=no),tcp(src=0/0,dst=0/0), packets:75, bytes:10988, used:1.410s, offloaded:yes, dp:tc
, actions:ct(zone=5),recirc(0x48b)
ufid:b9a8ada9-8ba8-48aa-8d90-ae5556caec2f, skb_priority(0/0),skb_mark(0/0),ct_state(0x22/0x3e),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x489),dp_hash(0/0),in_port(ens6f0_1),packet_type(ns=0/0,id=0/0)
,eth(src=fa:16:3e:df:59:67,dst=fa:16:3e:5f:da:b4),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=50.50.220.0/255.255.255.128,proto=0/0,tos=0/0,ttl=0/0,frag=no), packets:40259224, bytes:357750308931, used:0.000s,
offloaded:yes, dp:tc, actions:push_vlan(vid=147,pcp=0),mx-bond
ufid:9a56a508-7f88-447b-8e76-f5b69293f555, skb_priority(0/0),skb_mark(0/0),ct_state(0x21/0x3f),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x48b),dp_hash(0/0),in_port(ens6f0_1),packet_type(ns=0/0,id=0/0)
,eth(src=fa:16:3e:4a:98:c2,dst=fa:16:3e:b8:d1:ab),eth_type(0x0800),ipv4(src=20.20.220.189,dst=128.0.0.0/192.0.0.0,proto=17,tos=0/0,ttl=64,frag=no),udp(src=0/0,dst=0/0), packets:1, bytes:76, used:2.730s, dp:tc, a
ctions:ct(commit,zone=5,mark=0/0x1,nat(src)),set(eth(src=fa:16:3e:eb:d3:05,dst=52:54:00:06:67:54)),set(ipv4(ttl=63)),ct(zone=2,nat),recirc(0x48c)
ufid:ea6c7d34-f867-4e91-8b86-3d877ec61038, skb_priority(0/0),skb_mark(0/0),ct_state(0x2a/0x3e),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x48b),dp_hash(0/0),in_port(ens6f0_1),packet_type(ns=0/0,id=0/0)
,eth(src=fa:16:3e:4a:98:c2,dst=fa:16:3e:b8:d1:ab),eth_type(0x0800),ipv4(src=20.20.220.189,dst=10.10.149.1,proto=6,tos=0/0,ttl=64,frag=no),tcp(src=0/0,dst=0/0), packets:75, bytes:10988, used:1.410s, offloaded:yes
, dp:tc, actions:ct_clear,set(eth(src=fa:16:3e:eb:d3:05,dst=52:54:00:06:67:54)),set(ipv4(ttl=63)),ct(zone=2,nat),recirc(0x48c)
ufid:13ba4df4-33da-4ca3-a032-9511fc52301b, skb_priority(0/0),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),recirc_id(0x48c),dp_hash(0/0),in_port(ens6f0_1),packet_type(ns=0/0,id=0/0),eth(src
=fa:16:3e:eb:d3:05,dst=00:00:00:00:00:00/00:00:00:00:00:00),eth_type(0x0800),ipv4(src=20.20.220.189,dst=0.0.0.0/0.0.0.0,proto=0/0,tos=0/0,ttl=0/0,frag=no), packets:1, bytes:76, used:2.730s, offloaded:yes, dp:tc,
 actions:ct(commit,zone=2,nat(src=10.10.149.55)),recirc(0x495)
ufid:b26ddf98-6aa4-45df-9fbc-a25f08a84ac8, skb_priority(0/0),skb_mark(0/0),ct_state(0x2a/0x3e),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x48c),dp_hash(0/0),in_port(ens6f0_1),packet_type(ns=0/0,id=0/0)
,eth(src=fa:16:3e:eb:d3:05,dst=52:54:00:06:67:54),eth_type(0x0800),ipv4(src=0.0.0.0/240.0.0.0,dst=10.10.149.0/255.255.255.224,proto=0/0,tos=0/0,ttl=0/0,frag=no), packets:75, bytes:11272, used:1.410s, offloaded:y
es, dp:tc, actions:ct_clear,push_vlan(vid=149,pcp=0),mx-bond
ufid:ebdc1a93-68d1-4adc-b378-83652d306ec4, skb_priority(0/0),skb_mark(0/0),ct_state(0x21/0x3f),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x495),dp_hash(0/0),in_port(ens6f0_1),packet_type(ns=0/0,id=0/0)
,eth(src=fa:16:3e:eb:d3:05,dst=52:54:00:06:67:54),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=128.0.0.0/128.0.0.0,proto=0/0,tos=0/0,ttl=0/0,frag=no), packets:1, bytes:76, used:2.730s, dp:tc, actions:ct_clear,p
ush_vlan(vid=149,pcp=0),mx-bond
ufid:9dc4fe21-c892-4470-abb9-2766bbcb8b30, recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(ens7f0),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=ec:13:db:41:b3:02,dst=01:80:c2:0
0:00:00),eth_type(0/0xffff), packets:792, bytes:47520, used:1.686s, dp:ovs, actions:drop
ufid:2d7ff51e-06e5-4161-acd6-6c9293815866, recirc_id(0),dp_hash(0/0),skb_priority(0/0),tunnel(tun_id=0x0,src=10.10.141.120,dst=10.10.141.123,ttl=0/0,flags(-df+csum+key)),in_port(genev_sys_6081),skb_mark(0/0),ct_
state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=c2:0f:6f:53:ca:a7,dst=00:00:00:00:00:00/00:00:00:00:00:00),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=0.0.0.0/0.0.0.0,proto=17,tos=0/0,ttl=0/0,frag=n
o),udp(src=0/0,dst=3784), packets:1733, bytes:114378, used:0.175s, dp:ovs, actions:userspace(pid=3059023755,slow_path(bfd))
ufid:1e54ac47-3b79-4380-9e64-52cb44cf7c9f, recirc_id(0),dp_hash(0/0),skb_priority(0/0),tunnel(tun_id=0x0,src=10.10.141.104,dst=10.10.141.123,ttl=0/0,flags(-df+csum+key)),in_port(genev_sys_6081),skb_mark(0/0),ct_
state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=de:a3:1d:e5:ec:06,dst=00:00:00:00:00:00/00:00:00:00:00:00),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=0.0.0.0/0.0.0.0,proto=17,tos=0/0,ttl=0/0,frag=n
o),udp(src=0/0,dst=3784), packets:1729, bytes:114114, used:0.475s, dp:ovs, actions:userspace(pid=3059023755,slow_path(bfd))
ufid:d7534d5f-8d4f-405f-bb70-4027376a5da5, recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(mx-bond),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=f4:52:14:25:28:7a,dst=01:80:c2:
00:00:00),eth_type(0/0xffff), packets:750, bytes:45000, used:0.846s, dp:ovs, actions:drop
ufid:a9b6efe5-4024-46a3-ab6e-49698ecfef01, recirc_id(0),dp_hash(0/0),skb_priority(0/0),tunnel(tun_id=0x0,src=10.10.141.114,dst=10.10.141.123,ttl=0/0,flags(-df+csum+key)),in_port(genev_sys_6081),skb_mark(0/0),ct_
state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=66:20:8f:3a:a4:0b,dst=00:00:00:00:00:00/00:00:00:00:00:00),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=0.0.0.0/0.0.0.0,proto=17,tos=0/0,ttl=0/0,frag=n
o),udp(src=0/0,dst=3784), packets:1729, bytes:114114, used:0.258s, dp:ovs, actions:userspace(pid=3059023755,slow_path(bfd))
ufid:42c9fd37-8ed6-4b7b-bf5f-1f0a5c32b07a, recirc_id(0),dp_hash(0/0),skb_priority(0/0),in_port(ens7f1),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=ec:13:db:41:b3:02,dst=01:80:c2:0
0:00:00),eth_type(0/0xffff), packets:792, bytes:47520, used:0.146s, dp:ovs, actions:drop
ufid:a35f03de-4f62-4ab3-b1c7-1c2e9c50b1a0, recirc_id(0),dp_hash(0/0),skb_priority(0/0),tunnel(tun_id=0x0,src=10.10.141.159,dst=10.10.141.123,ttl=0/0,flags(-df+csum+key)),in_port(genev_sys_6081),skb_mark(0/0),ct_
state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),eth(src=f2:6b:7f:28:13:47,dst=00:00:00:00:00:00/00:00:00:00:00:00),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=0.0.0.0/0.0.0.0,proto=17,tos=0/0,ttl=0/0,frag=n
o),udp(src=0/0,dst=3784), packets:1725, bytes:113850, used:0.309s, dp:ovs, actions:userspace(pid=3059023755,slow_path(bfd))
***************************************************
CONNTRACK TABLE
***************************************************
[root@computehwoffload-r730-0 heat-admin]# sudo cat /proc/net/nf_conntrack                                                                                                                                 [43/169]
ipv4     2 tcp      6 src=50.50.220.179 dst=50.50.220.126 sport=57824 dport=8154 src=50.50.220.126 dst=50.50.220.179 sport=8154 dport=57824 [HW_OFFLOAD] mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=8 use=
3                                                                                                                                                                                                                  
ipv4     2 udp      17 2 src=10.10.145.130 dst=216.239.35.4 sport=51544 dport=123 src=216.239.35.4 dst=10.10.145.130 sport=123 dport=51544 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 use=2             
ipv4     2 udp      17 29 src=10.10.141.104 dst=10.10.141.159 sport=36772 dport=6081 [UNREPLIED] src=10.10.141.159 dst=10.10.141.104 sport=6081 dport=36772 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 $
se=2                                                                                                                                                                                                               
ipv4     2 tcp      6 21 TIME_WAIT src=10.10.140.131 dst=10.10.140.171 sport=40816 dport=8778 src=10.10.140.171 dst=10.10.140.131 sport=8778 dport=40816 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_t:s0 $
one=0 use=2                                                                                                                                                                                                        
ipv4     2 tcp      6 src=10.10.149.1 dst=10.10.149.51 sport=46634 dport=22 src=20.20.220.175 dst=10.10.149.1 sport=22 dport=46634 [HW_OFFLOAD] mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=2 use=3        
ipv4     2 tcp      6 73 TIME_WAIT src=10.10.140.131 dst=10.10.140.171 sport=56048 dport=9696 src=10.10.140.171 dst=10.10.140.131 sport=9696 dport=56048 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_t:s0 z
one=0 use=2
ipv4     2 udp      17 29 src=10.10.141.120 dst=10.10.141.104 sport=35196 dport=6081 [UNREPLIED] src=10.10.141.104 dst=10.10.141.120 sport=6081 dport=35196 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 u
se=2
ipv4     2 tcp      6 431998 ESTABLISHED src=10.10.140.131 dst=10.10.140.110 sport=58176 dport=5672 src=10.10.140.110 dst=10.10.140.131 sport=5672 dport=58176 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2
ipv4     2 tcp      6 431999 ESTABLISHED src=10.10.140.131 dst=10.10.140.110 sport=45986 dport=5672 src=10.10.140.110 dst=10.10.140.131 sport=5672 dport=45986 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2
ipv4     2 udp      17 29 src=10.10.141.159 dst=10.10.141.104 sport=46468 dport=6081 [UNREPLIED] src=10.10.141.104 dst=10.10.141.159 sport=6081 dport=46468 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 u
se=2
ipv4     2 tcp      6 13 TIME_WAIT src=10.10.140.131 dst=10.10.140.171 sport=59932 dport=9696 src=10.10.140.171 dst=10.10.140.131 sport=9696 dport=59932 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_t:s0 z
one=0 use=2
ipv4     2 tcp      6 431996 ESTABLISHED src=10.10.140.131 dst=10.10.140.173 sport=56578 dport=5672 src=10.10.140.173 dst=10.10.140.131 sport=5672 dport=56578 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2
ipv4     2 tcp      6 431999 ESTABLISHED src=10.10.140.131 dst=10.10.140.110 sport=56132 dport=5672 src=10.10.140.110 dst=10.10.140.131 sport=5672 dport=56132 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2
ipv4     2 udp      17 29 src=10.10.141.123 dst=10.10.141.104 sport=61660 dport=6081 [UNREPLIED] src=10.10.141.104 dst=10.10.141.123 sport=6081 dport=61660 mark=0 secctx=system_u:object_r:unlabeled_t:s0 [18/169]
se=2
ipv4     2 tcp      6 298 ESTABLISHED src=10.10.140.131 dst=10.10.140.147 sport=41444 dport=5672 src=10.10.140.147 dst=10.10.140.131 sport=5672 dport=41444 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_t:s
0 zone=0 use=2
ipv4     2 udp      17 29 src=10.10.141.114 dst=10.10.141.104 sport=46884 dport=6081 [UNREPLIED] src=10.10.141.104 dst=10.10.141.114 sport=6081 dport=46884 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 u
se=2
ipv4     2 tcp      6 src=10.10.149.1 dst=20.20.220.175 sport=46634 dport=22 src=20.20.220.175 dst=10.10.149.1 sport=22 dport=46634 [HW_OFFLOAD] mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=10 use=3
ipv4     2 tcp      6 32 CLOSE_WAIT src=10.10.140.131 dst=10.10.140.171 sport=53198 dport=8778 src=10.10.140.171 dst=10.10.140.131 sport=8778 dport=53198 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_t:s0
zone=0 use=2
ipv4     2 tcp      6 431998 ESTABLISHED src=10.10.140.131 dst=10.10.140.173 sport=52740 dport=5672 src=10.10.140.173 dst=10.10.140.131 sport=5672 dport=52740 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2
ipv4     2 tcp      6 431999 ESTABLISHED src=10.10.140.131 dst=10.10.140.115 sport=48458 dport=6642 src=10.10.140.115 dst=10.10.140.131 sport=6642 dport=48458 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2
ipv4     2 tcp      6 431980 ESTABLISHED src=127.0.0.1 dst=127.0.0.1 sport=56269 dport=35932 src=127.0.0.1 dst=127.0.0.1 sport=35932 dport=56269 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 us
e=2
ipv4     2 udp      17 29 src=10.10.141.104 dst=10.10.141.120 sport=4746 dport=6081 [UNREPLIED] src=10.10.141.120 dst=10.10.141.104 sport=6081 dport=4746 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 use
=2
ipv4     2 tcp      6 431996 ESTABLISHED src=10.10.140.131 dst=10.10.140.173 sport=56574 dport=5672 src=10.10.140.173 dst=10.10.140.131 sport=5672 dport=56574 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2
ipv4     2 tcp      6 432000 ESTABLISHED src=192.0.80.1 dst=192.0.80.12 sport=33860 dport=22 src=192.0.80.12 dst=192.0.80.1 sport=22 dport=33860 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 us
e=2
ipv4     2 tcp      6 431999 ESTABLISHED src=10.10.140.131 dst=10.10.140.115 sport=48466 dport=6642 src=10.10.140.115 dst=10.10.140.131 sport=6642 dport=48466 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2
ipv4     2 udp      17 8 src=20.20.220.175 dst=164.92.155.23 sport=45134 dport=123 src=164.92.155.23 dst=10.10.149.51 sport=123 dport=45134 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=2 use=2
ipv4     2 udp      17 8 src=20.20.220.175 dst=164.92.155.23 sport=45134 dport=123 src=164.92.155.23 dst=20.20.220.175 sport=123 dport=45134 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=10 use=2
ipv4     2 tcp      6 431997 ESTABLISHED src=10.10.140.131 dst=10.10.140.147 sport=48104 dport=5672 src=10.10.140.147 dst=10.10.140.131 sport=5672 dport=48104 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2
ipv4     2 tcp      6 82 TIME_WAIT src=10.10.140.131 dst=10.10.140.171 sport=50450 dport=8778 src=10.10.140.171 dst=10.10.140.131 sport=8778 dport=50450 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_t:s0 z
one=0 use=2
ipv4     2 tcp      6 431995 ESTABLISHED src=10.10.140.131 dst=10.10.140.115 sport=48460 dport=6642 src=10.10.140.115 dst=10.10.140.131 sport=6642 dport=48460 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2
ipv4     2 tcp      6 431998 ESTABLISHED src=10.10.140.131 dst=10.10.140.110 sport=45982 dport=5672 src=10.10.140.110 dst=10.10.140.131 sport=5672 dport=45982 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2
ipv4     2 udp      17 29 src=10.10.141.104 dst=10.10.141.123 sport=7456 dport=6081 [UNREPLIED] src=10.10.141.123 dst=10.10.141.104 sport=6081 dport=7456 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 use
=2
ipv4     2 udp      17 29 src=10.10.141.104 dst=10.10.141.114 sport=47130 dport=6081 [UNREPLIED] src=10.10.141.114 dst=10.10.141.104 sport=6081 dport=47130 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 u
se=2
ipv4     2 tcp      6 431999 ESTABLISHED src=127.0.0.1 dst=127.0.0.1 sport=6640 dport=35490 src=127.0.0.1 dst=127.0.0.1 sport=35490 dport=6640 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 use=
2
ipv4     2 tcp      6 431980 ESTABLISHED src=10.10.140.131 dst=10.10.140.115 sport=48424 dport=6642 src=10.10.140.115 dst=10.10.140.131 sport=6642 dport=48424 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2
ipv4     2 tcp      6 430857 ESTABLISHED src=50.50.220.179 dst=50.50.220.126 sport=57820 dport=8154 src=50.50.220.126 dst=50.50.220.179 sport=8154 dport=57820 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=8 use=2




[root@computehwoffload-r740-0 heat-admin]# sudo cat /proc/net/nf_conntrack                                                                                                                                 [48/264]
ipv4     2 tcp      6 431997 ESTABLISHED src=10.10.140.161 dst=10.10.140.173 sport=37036 dport=5672 src=10.10.140.173 dst=10.10.140.161 sport=5672 dport=37036 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2                                                                                                                                                                                                  
ipv4     2 tcp      6 431995 ESTABLISHED src=10.10.140.161 dst=10.10.140.110 sport=53168 dport=5672 src=10.10.140.110 dst=10.10.140.161 sport=5672 dport=53168 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled$
t:s0 zone=0 use=2                                                                                                                                                                                                  
ipv4     2 udp      17 29 src=10.10.141.104 dst=10.10.141.123 sport=7456 dport=6081 [UNREPLIED] src=10.10.141.123 dst=10.10.141.104 sport=6081 dport=7456 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 us$
=2                                                                                                                                                                                                                 
ipv4     2 tcp      6 431998 ESTABLISHED src=10.10.140.161 dst=10.10.140.147 sport=42682 dport=5672 src=10.10.140.147 dst=10.10.140.161 sport=5672 dport=42682 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled$
t:s0 zone=0 use=2                                                                                                                                                                                                  
ipv4     2 tcp      6 src=50.50.220.179 dst=50.50.220.126 sport=57824 dport=8154 src=50.50.220.126 dst=50.50.220.179 sport=8154 dport=57824 [HW_OFFLOAD] mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=9 use$
3                                                                                                                                                                                                                  
ipv4     2 tcp      6 33 TIME_WAIT src=10.10.140.161 dst=10.10.140.171 sport=42408 dport=8778 src=10.10.140.171 dst=10.10.140.161 sport=8778 dport=42408 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_t:s0 $
one=0 use=2                                                                                                                                                                                                        
ipv4     2 tcp      6 431981 ESTABLISHED src=127.0.0.1 dst=127.0.0.1 sport=51765 dport=38032 src=127.0.0.1 dst=127.0.0.1 sport=38032 dport=51765 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 u$
e=2                                                                                                                                                                                                                
ipv4     2 tcp      6 431997 ESTABLISHED src=10.10.140.161 dst=10.10.140.115 sport=37992 dport=6642 src=10.10.140.115 dst=10.10.140.161 sport=6642 dport=37992 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled$
t:s0 zone=0 use=2                                                                                                                                                                                                  
ipv4     2 tcp      6 44 CLOSE_WAIT src=10.10.140.161 dst=10.10.140.171 sport=43684 dport=8778 src=10.10.140.171 dst=10.10.140.161 sport=8778 dport=43684 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_t:s0
zone=0 use=2
ipv4     2 tcp      6 431996 ESTABLISHED src=10.10.140.161 dst=10.10.140.115 sport=37972 dport=6642 src=10.10.140.115 dst=10.10.140.161 sport=6642 dport=37972 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled$
t:s0 zone=0 use=2
ipv4     2 udp      17 29 src=10.10.141.120 dst=10.10.141.123 sport=31651 dport=6081 [UNREPLIED] src=10.10.141.123 dst=10.10.141.120 sport=6081 dport=31651 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 $
se=2
ipv4     2 tcp      6 431996 ESTABLISHED src=10.10.140.161 dst=10.10.140.110 sport=49064 dport=5672 src=10.10.140.110 dst=10.10.140.161 sport=5672 dport=49064 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2
ipv4     2 tcp      6 431998 ESTABLISHED src=10.10.140.161 dst=10.10.140.147 sport=56768 dport=5672 src=10.10.140.147 dst=10.10.140.161 sport=5672 dport=56768 [ASSURED] mark=0 secctx=system_u:object_r:un[23/264]
t:s0 zone=0 use=2
ipv4     2 udp      17 29 src=10.10.141.123 dst=10.10.141.104 sport=61660 dport=6081 [UNREPLIED] src=10.10.141.104 dst=10.10.141.123 sport=6081 dport=61660 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 u
se=2
ipv4     2 tcp      6 431971 ESTABLISHED src=10.10.140.161 dst=10.10.140.115 sport=37944 dport=6642 src=10.10.140.115 dst=10.10.140.161 sport=6642 dport=37944 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2
ipv4     2 tcp      6 src=10.10.149.1 dst=20.20.220.189 sport=34870 dport=22 src=20.20.220.189 dst=10.10.149.1 sport=22 dport=34870 [HW_OFFLOAD] mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=5 use=3
ipv4     2 tcp      6 431996 ESTABLISHED src=10.10.140.161 dst=10.10.140.110 sport=42664 dport=5672 src=10.10.140.110 dst=10.10.140.161 sport=5672 dport=42664 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2
ipv4     2 tcp      6 src=10.10.149.1 dst=10.10.149.55 sport=34870 dport=22 src=20.20.220.189 dst=10.10.149.1 sport=22 dport=34870 [HW_OFFLOAD] mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=2 use=3
ipv4     2 tcp      6 431995 ESTABLISHED src=10.10.140.161 dst=10.10.140.147 sport=39332 dport=5672 src=10.10.140.147 dst=10.10.140.161 sport=5672 dport=39332 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2
ipv4     2 tcp      6 431995 ESTABLISHED src=10.10.140.161 dst=10.10.140.115 sport=37982 dport=6642 src=10.10.140.115 dst=10.10.140.161 sport=6642 dport=37982 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2
ipv4     2 tcp      6 431999 ESTABLISHED src=10.10.140.161 dst=10.10.140.173 sport=37022 dport=5672 src=10.10.140.173 dst=10.10.140.161 sport=5672 dport=37022 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2
ipv4     2 udp      17 5 src=20.20.220.189 dst=176.230.251.106 sport=47767 dport=123 src=176.230.251.106 dst=10.10.149.55 sport=123 dport=47767 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=2 use=2
ipv4     2 udp      17 5 src=20.20.220.189 dst=176.230.251.106 sport=47767 dport=123 src=176.230.251.106 dst=20.20.220.189 sport=123 dport=47767 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=5 use=2
ipv4     2 udp      17 29 src=10.10.141.123 dst=10.10.141.114 sport=41116 dport=6081 [UNREPLIED] src=10.10.141.114 dst=10.10.141.123 sport=6081 dport=41116 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 u
se=2
ipv4     2 tcp      6 431999 ESTABLISHED src=127.0.0.1 dst=127.0.0.1 sport=6640 dport=37008 src=127.0.0.1 dst=127.0.0.1 sport=37008 dport=6640 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 use=
2
ipv4     2 tcp      6 118 TIME_WAIT src=10.10.140.161 dst=10.10.140.171 sport=57674 dport=9696 src=10.10.140.171 dst=10.10.140.161 sport=9696 dport=57674 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_t:s0
zone=0 use=2
ipv4     2 tcp      6 431999 ESTABLISHED src=10.10.140.161 dst=10.10.140.171 sport=45378 dport=9696 src=10.10.140.171 dst=10.10.140.161 sport=9696 dport=45378 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2
ipv4     2 tcp      6 94 TIME_WAIT src=10.10.140.161 dst=10.10.140.171 sport=43602 dport=8778 src=10.10.140.171 dst=10.10.140.161 sport=8778 dport=43602 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_t:s0 z
one=0 use=2
ipv4     2 udp      17 29 src=10.10.141.123 dst=10.10.141.120 sport=1784 dport=6081 [UNREPLIED] src=10.10.141.120 dst=10.10.141.123 sport=6081 dport=1784 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 use
=2
ipv4     2 udp      17 29 src=10.10.141.123 dst=10.10.141.159 sport=59862 dport=6081 [UNREPLIED] src=10.10.141.159 dst=10.10.141.123 sport=6081 dport=59862 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 u
se=2
ipv4     2 udp      17 18 src=20.20.220.189 dst=81.0.208.219 sport=57338 dport=123 src=81.0.208.219 dst=10.10.149.55 sport=123 dport=57338 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=2 use=2
ipv4     2 udp      17 18 src=20.20.220.189 dst=81.0.208.219 sport=57338 dport=123 src=81.0.208.219 dst=20.20.220.189 sport=123 dport=57338 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=5 use=2
ipv4     2 tcp      6 431999 ESTABLISHED src=10.10.140.161 dst=10.10.140.147 sport=56784 dport=5672 src=10.10.140.147 dst=10.10.140.161 sport=5672 dport=56784 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2
ipv4     2 udp      17 29 src=10.10.141.114 dst=10.10.141.123 sport=37067 dport=6081 [UNREPLIED] src=10.10.141.123 dst=10.10.141.114 sport=6081 dport=37067 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 u
se=2
ipv4     2 udp      17 29 src=10.10.141.159 dst=10.10.141.123 sport=3170 dport=6081 [UNREPLIED] src=10.10.141.123 dst=10.10.141.159 sport=6081 dport=3170 mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 use
=2
ipv4     2 tcp      6 431996 ESTABLISHED src=10.10.140.161 dst=10.10.140.110 sport=49062 dport=5672 src=10.10.140.110 dst=10.10.140.161 sport=5672 dport=49062 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=0 use=2
ipv4     2 tcp      6 56 TIME_WAIT src=10.10.140.161 dst=10.10.140.171 sport=42144 dport=9696 src=10.10.140.171 dst=10.10.140.161 sport=9696 dport=42144 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_t:s0 z
one=0 use=2
ipv4     2 tcp      6 431999 ESTABLISHED src=192.0.80.1 dst=192.0.80.14 sport=49376 dport=22 src=192.0.80.14 dst=192.0.80.1 sport=22 dport=49376 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_t:s0 zone=0 us
e=2
ipv4     2 tcp      6 430849 ESTABLISHED src=50.50.220.179 dst=50.50.220.126 sport=57820 dport=8154 src=50.50.220.126 dst=50.50.220.179 sport=8154 dport=57820 [ASSURED] mark=0 secctx=system_u:object_r:unlabeled_
t:s0 zone=9 use=2

Comment 11 Miguel Angel Nieto 2023-02-23 16:12:34 UTC

I see one flow not offloaded, should it be offloaded?

[root@computehwoffload-r730-0 heat-admin]# ovs-appctl dpctl/dump-flows -m | grep 50.50
ufid:9419efeb-4672-4a9c-8a89-299e27adf726, skb_priority(0/0),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),recirc_id(0),dp_hash(0/0),in_port(enp4s0f0_3),packet_type(ns=0/0,id=0/0),eth(src=fa:16:3e:5f:da:b4,dst=fa:16:3e:df:59:67),eth_type(0x8100),vlan(vid=147,pcp=0),encap(eth_type(0x0800),ipv4(src=50.50.220.126,dst=50.50.220.128/255.255.255.192,proto=6,tos=0/0,ttl=0/0,frag=no),tcp(src=0/0,dst=0/0)), packets:12017690, bytes:624919984, used:0.000s, dp:tc, actions:pop_vlan,ct(zone=8),recirc(0x4f9)
ufid:eae05658-59d5-440f-83b0-42db2a303eb9, skb_priority(0/0),skb_mark(0/0),ct_state(0x2a/0x3e),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x4f9),dp_hash(0/0),in_port(enp4s0f0_3),packet_type(ns=0/0,id=0/0),eth(src=fa:16:3e:5f:da:b4,dst=fa:16:3e:df:59:67),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=50.50.220.128/255.255.255.192,proto=0/0,tos=0/0,ttl=0/0,frag=no), packets:12017690, bytes:624919984, used:0.000s, offloaded:yes, dp:tc, actions:push_vlan(vid=147,pcp=0),mx-bond
ufid:b35d8227-84fe-4e81-a33d-1c80d32cd939, skb_priority(0/0),skb_mark(0/0),ct_state(0x22/0x3e),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x4f8),dp_hash(0/0),in_port(mx-bond),packet_type(ns=0/0,id=0/0),eth(src=fa:16:3e:df:59:67,dst=fa:16:3e:5f:da:b4),eth_type(0x0800),ipv4(src=50.50.220.179,dst=50.50.220.126,proto=0/0,tos=0/0,ttl=0/0,frag=no), packets:414857422, bytes:3710443560698, used:0.490s, offloaded:yes, dp:tc, actions:push_vlan(vid=147,pcp=0),enp4s0f0_3


root@computehwoffload-r740-0 heat-admin]# ovs-appctl dpctl/dump-flows -m | grep 50.50
ufid:368db2cd-870f-44f0-8a92-4a1bcc909489, skb_priority(0/0),skb_mark(0/0),ct_state(0x2a/0x3e),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x48a),dp_hash(0/0),in_port(mx-bond),packet_type(ns=0/0,id=0/0),eth(src=00:00:00:00:00:00/00:00:00:00:00:00,dst=fa:16:3e:df:59:67),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=50.50.220.179,proto=0/0,tos=0/0,ttl=0/0,frag=no), packets:12647362, bytes:834725940, used:0.270s, offloaded:yes, dp:tc, actions:push_vlan(vid=147,pcp=0),ens6f0_1
ufid:90cfd4cf-fb0d-4ea8-9d3f-41f3b13b94c9, skb_priority(0/0),skb_mark(0/0),ct_state(0/0),ct_zone(0/0),ct_mark(0/0),ct_label(0/0),recirc_id(0),dp_hash(0/0),in_port(ens6f0_1),packet_type(ns=0/0,id=0/0),eth(src=fa:16:3e:df:59:67,dst=fa:16:3e:5f:da:b4),eth_type(0x8100),vlan(vid=147,pcp=0),encap(eth_type(0x0800),ipv4(src=50.50.220.179,dst=0.0.0.0/0.0.0.0,proto=6,tos=0/0,ttl=0/0,frag=no),tcp(src=0/0,dst=0/0)), packets:436756481, bytes:3880806603250, used:0.000s, dp:tc, actions:pop_vlan,ct(zone=9),recirc(0x489)
ufid:b9a8ada9-8ba8-48aa-8d90-ae5556caec2f, skb_priority(0/0),skb_mark(0/0),ct_state(0x22/0x3e),ct_zone(0/0),ct_mark(0/0x1),ct_label(0/0),recirc_id(0x489),dp_hash(0/0),in_port(ens6f0_1),packet_type(ns=0/0,id=0/0),eth(src=fa:16:3e:df:59:67,dst=fa:16:3e:5f:da:b4),eth_type(0x0800),ipv4(src=0.0.0.0/0.0.0.0,dst=50.50.220.0/255.255.255.128,proto=0/0,tos=0/0,ttl=0/0,frag=no), packets:436756478, bytes:3880806603049, used:0.000s, offloaded:yes, dp:tc, actions:push_vlan(vid=147,pcp=0),mx-bond


In representor port I can see packets, so they are not offloaded
[root@computehwoffload-r730-0 heat-admin]# tcpdump -i enp4s0f0_3 -nne -c 15                                                                                                                                        
dropped privs to tcpdump                                                                                                                                                                                           
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode                                                                                                                                         
listening on enp4s0f0_3, link-type EN10MB (Ethernet), capture size 262144 bytes                                                                                                                                    
16:11:53.471222 fa:16:3e:5f:da:b4 > fa:16:3e:df:59:67, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.126.8154 > 50.50.220.179.57824: Flags [.], ack 2336337836, win 24303, options
 [nop,nop,TS val 1485692706 ecr 128366097], length 0                                                                                                                                                               
16:11:53.471317 fa:16:3e:5f:da:b4 > fa:16:3e:df:59:67, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.126.8154 > 50.50.220.179.57824: Flags [.], ack 631191, win 22080, options [no
p,nop,TS val 1485692706 ecr 128366097], length 0                                                                                                                                                                   
16:11:53.471525 fa:16:3e:5f:da:b4 > fa:16:3e:df:59:67, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.126.8154 > 50.50.220.179.57824: Flags [.], ack 693421, win 24303, options [no
p,nop,TS val 1485692706 ecr 128366097], length 0                                                                                                                                                                   
16:11:53.471627 fa:16:3e:5f:da:b4 > fa:16:3e:df:59:67, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.126.8154 > 50.50.220.179.57824: Flags [.], ack 1386841, win 21807, options [n
op,nop,TS val 1485692706 ecr 128366097], length 0                                                                                                                                                                  
16:11:53.471835 fa:16:3e:5f:da:b4 > fa:16:3e:df:59:67, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.126.8154 > 50.50.220.179.57824: Flags [.], ack 1449071, win 24303, options [nop,nop,TS val 1485692706 ecr 128366097], length 0
16:11:53.471934 fa:16:3e:5f:da:b4 > fa:16:3e:df:59:67, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.126.8154 > 50.50.220.179.57824: Flags [.], ack 2150271, win 21733, options [$op,nop,TS val 1485692706 ecr 128366097], length 0
16:11:53.472154 fa:16:3e:5f:da:b4 > fa:16:3e:df:59:67, ethertype 802.1Q (0x8100), length 70: vlan 147, p 0, ethertype IPv4, 50.50.220.126.8154 > 50.50.220.179.57824: Flags [.], ack 2212501, win 24303, options [$op,nop,TS val 1485692707 ecr 128366098], length 0



[root@computehwoffload-r740-0 heat-admin]# tcpdump -i ens6f0_1 -nne -c 15                                                                                                                                          
dropped privs to tcpdump                                                                                                                                                                                           
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode                                                                                                                                         
listening on ens6f0_1, link-type EN10MB (Ethernet), capture size 262144 bytes                                                                                                                                      
16:11:33.304113 fa:16:3e:df:59:67 > fa:16:3e:5f:da:b4, ethertype 802.1Q (0x8100), length 62300: vlan 147, p 0, ethertype IPv4, 50.50.220.179.57824 > 50.50.220.126.8154: Flags [.], seq 2168929722:2168991952, ack 
2950647778, win 209, options [nop,nop,TS val 128345930 ecr 1485672537], length 62230                                                                                                                               
16:11:33.304164 fa:16:3e:df:59:67 > fa:16:3e:5f:da:b4, ethertype 802.1Q (0x8100), length 62300: vlan 147, p 0, ethertype IPv4, 50.50.220.179.57824 > 50.50.220.126.8154: Flags [.], seq 62230:124460, ack 1, win 20
9, options [nop,nop,TS val 128345930 ecr 1485672538], length 62230                                                                                                                                                 
16:11:33.304207 fa:16:3e:df:59:67 > fa:16:3e:5f:da:b4, ethertype 802.1Q (0x8100), length 62300: vlan 147, p 0, ethertype IPv4, 50.50.220.179.57824 > 50.50.220.126.8154: Flags [.], seq 124460:186690, ack 1, win 2
09, options [nop,nop,TS val 128345930 ecr 1485672538], length 62230                                                                                                                                                
16:11:33.304250 fa:16:3e:df:59:67 > fa:16:3e:5f:da:b4, ethertype 802.1Q (0x8100), length 62300: vlan 147, p 0, ethertype IPv4, 50.50.220.179.57824 > 50.50.220.126.8154: Flags [.], seq 186690:248920, ack 1, win 2
09, options [nop,nop,TS val 128345930 ecr 1485672538], length 62230                                                                                                                                                
16:11:33.304296 fa:16:3e:df:59:67 > fa:16:3e:5f:da:b4, ethertype 802.1Q (0x8100), length 62300: vlan 147, p 0, ethertype IPv4, 50.50.220.179.57824 > 50.50.220.126.8154: Flags [.], seq 248920:311150, ack 1, win 209, options [nop,nop,TS val 128345930 ecr 1485672538], length 62230
16:11:33.304343 fa:16:3e:df:59:67 > fa:16:3e:5f:da:b4, ethertype 802.1Q (0x8100), length 62300: vlan 147, p 0, ethertype IPv4, 50.50.220.179.57824 > 50.50.220.126.8154: Flags [.], seq 311150:373380, ack 1, win $09, options [nop,nop,TS val 128345930 ecr 1485672538], length 62230
16:11:33.304387 fa:16:3e:df:59:67 > fa:16:3e:5f:da:b4, ethertype 802.1Q (0x8100), length 62300: vlan 147, p 0, ethertype IPv4, 50.50.220.179.57824 > 50.50.220.126.8154: Flags [.], seq 373380:435610, ack 1, win $09, options [nop,nop,TS val 128345930 ecr 1485672538], length 62230

Note You need to log in before you can comment on or make changes to this bug.