Bug 1595115
| Summary: | [stability] When a VLAN and VxLAN network is associated to the same neutron router, Ping to VM FIP fails for some of the VMs. | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Product: | Red Hat OpenStack | Reporter: | Janki <jchhatba> | ||||||||
| Component: | opendaylight | Assignee: | Sridhar Gaddam <sgaddam> | ||||||||
| Status: | CLOSED WONTFIX | QA Contact: | Noam Manos <nmanos> | ||||||||
| Severity: | medium | Docs Contact: | |||||||||
| Priority: | medium | ||||||||||
| Version: | 13.0 (Queens) | CC: | aadam, mkolesni, oblaut | ||||||||
| Target Milestone: | --- | Keywords: | Triaged, ZStream | ||||||||
| Target Release: | 14.0 (Rocky) | ||||||||||
| Hardware: | Unspecified | ||||||||||
| OS: | Unspecified | ||||||||||
| Whiteboard: | Netvirt | ||||||||||
| Fixed In Version: | Doc Type: | If docs needed, set a value | |||||||||
| Doc Text: | Story Points: | --- | |||||||||
| Clone Of: | Environment: | ||||||||||
| Last Closed: | 2019-03-06 16:14:38 UTC | Type: | Bug | ||||||||
| Regression: | --- | Mount Type: | --- | ||||||||
| Documentation: | --- | CRM: | |||||||||
| Verified Versions: | Category: | --- | |||||||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||||||
| Embargoed: | |||||||||||
| Attachments: |
|
||||||||||
Created attachment 1454570 [details]
data-store dumps for all 3 ODLs via ODLTools
Created attachment 1454571 [details]
ovs flows for all controllers and computes
source stackrc
$ nova list
+--------------------------------------+--------------+--------+------------+-------------+------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------------+--------+------------+-------------+------------------------+
| 3dc6f2c5-7014-4922-949a-8b78b8a7dce9 | compute-0 | ACTIVE | - | Running | ctlplane=192.168.24.14 |
| 0cd63555-5d8e-4fac-b580-6b3cdb7d9d18 | compute-1 | ACTIVE | - | Running | ctlplane=192.168.24.6 |
| cf2a1fe8-4c7f-4288-a4c7-5b5f1971ad06 | controller-0 | ACTIVE | - | Running | ctlplane=192.168.24.19 |
| eb137c21-9f9b-4d24-922e-258cf02cc26b | controller-1 | ACTIVE | - | Running | ctlplane=192.168.24.11 |
| 12bb1efe-cabd-47ea-9337-78cb340d9538 | controller-2 | ACTIVE | - | Running | ctlplane=192.168.24.10 |
+--------------------------------------+--------------+--------+------------+-------------+------------------------+
source overcloudrc
$ neutron net-list
neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead.
+--------------------------------------+--------+----------------------------------+------------------------------------------------------+
| id | name | tenant_id | subnets |
+--------------------------------------+--------+----------------------------------+------------------------------------------------------+
| 6f7bb668-d3aa-45a4-ac3c-51a76fdcb76b | vlan1 | 123f7723b6d64dc59a62dcd1834f4699 | d0aa19d4-7570-4e36-8772-844141ba62df 90.0.0.0/24 |
| 855a5699-79e4-4aa8-9cc2-d16a9dbb1504 | vxlan1 | 123f7723b6d64dc59a62dcd1834f4699 | b3197718-2057-4583-a391-e6dbf971cd4a 192.168.99.0/24 |
| 8e757f77-f4bf-4585-85fa-2d2ce0ac4e61 | public | 123f7723b6d64dc59a62dcd1834f4699 | b171ed59-5ab0-454c-9919-d357fff202ab 10.0.0.0/24 |
+--------------------------------------+--------+----------------------------------+------------------------------------------------------+
$ neutron router-list
neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead.
+--------------------------------------+---------+----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------+
| id | name | tenant_id | external_gateway_info | distributed |
+--------------------------------------+---------+----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------+
| 24e51d91-51bf-4953-a3e7-6ee0e559a251 | router1 | 123f7723b6d64dc59a62dcd1834f4699 | {"network_id": "8e757f77-f4bf-4585-85fa-2d2ce0ac4e61", "enable_snat": true, "external_fixed_ips": [{"subnet_id": "b171ed59-5ab0-454c-9919-d357fff202ab", "ip_address": "10.0.0.210"}]} | False |
+--------------------------------------+---------+----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------+
$ neutron port-list
neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead.
+--------------------------------------+------+----------------------------------+-------------------+--------------------------------------------------------------------------------------+
| id | name | tenant_id | mac_address | fixed_ips |
+--------------------------------------+------+----------------------------------+-------------------+--------------------------------------------------------------------------------------+
| 010d4c56-ed6d-400c-a747-2f39dc32a2a5 | | | fa:16:3e:58:fe:03 | {"subnet_id": "b171ed59-5ab0-454c-9919-d357fff202ab", "ip_address": "10.0.0.221"} |
| 38cab631-09e3-4ee2-bdab-d289b175acd7 | | 123f7723b6d64dc59a62dcd1834f4699 | fa:16:3e:d3:32:8a | {"subnet_id": "b3197718-2057-4583-a391-e6dbf971cd4a", "ip_address": "192.168.99.4"} |
| 3f6b50e2-a511-4e4d-8b67-90cebada2f88 | | 123f7723b6d64dc59a62dcd1834f4699 | fa:16:3e:03:38:a0 | {"subnet_id": "b3197718-2057-4583-a391-e6dbf971cd4a", "ip_address": "192.168.99.7"} |
| 49c3d8b0-f4d6-4540-9ef9-e7007c464606 | | 123f7723b6d64dc59a62dcd1834f4699 | fa:16:3e:04:92:77 | {"subnet_id": "b3197718-2057-4583-a391-e6dbf971cd4a", "ip_address": "192.168.99.1"} |
| 80d23151-dd69-4370-b663-9d300bf39106 | | 123f7723b6d64dc59a62dcd1834f4699 | fa:16:3e:8b:ec:de | {"subnet_id": "b3197718-2057-4583-a391-e6dbf971cd4a", "ip_address": "192.168.99.2"} |
| 919cc9b3-1f3b-4c29-a366-77d740a9402f | | 123f7723b6d64dc59a62dcd1834f4699 | fa:16:3e:ff:cd:41 | {"subnet_id": "d0aa19d4-7570-4e36-8772-844141ba62df", "ip_address": "90.0.0.3"} |
| 939bace9-078b-4e4a-abc5-9beea35fcb27 | | 123f7723b6d64dc59a62dcd1834f4699 | fa:16:3e:32:6b:1c | {"subnet_id": "d0aa19d4-7570-4e36-8772-844141ba62df", "ip_address": "90.0.0.12"} |
| c1000c27-280b-4b62-8a8e-94d09f125e49 | | | fa:16:3e:fb:3d:8f | {"subnet_id": "b171ed59-5ab0-454c-9919-d357fff202ab", "ip_address": "10.0.0.210"} |
| c136d623-0dd0-4908-bcf1-acc1b702133d | | 123f7723b6d64dc59a62dcd1834f4699 | fa:16:3e:fc:4a:fc | {"subnet_id": "d0aa19d4-7570-4e36-8772-844141ba62df", "ip_address": "90.0.0.13"} |
| d2c4b5c1-e0d9-4dbe-bfff-a063c0ec9741 | | 123f7723b6d64dc59a62dcd1834f4699 | fa:16:3e:65:71:e1 | {"subnet_id": "d0aa19d4-7570-4e36-8772-844141ba62df", "ip_address": "90.0.0.4"} |
| d344e0ef-aea1-4e44-9c1c-40c20ed61498 | | | fa:16:3e:fe:18:3b | {"subnet_id": "b171ed59-5ab0-454c-9919-d357fff202ab", "ip_address": "10.0.0.212"} |
| e0d5d0b8-4d30-4447-8fd4-5615a5629cf6 | | | fa:16:3e:14:4c:fb | {"subnet_id": "b171ed59-5ab0-454c-9919-d357fff202ab", "ip_address": "10.0.0.223"} |
| e8efb2ef-2fd3-4bd8-81ed-ac0e480cbf7c | | 123f7723b6d64dc59a62dcd1834f4699 | fa:16:3e:4e:61:e5 | {"subnet_id": "b3197718-2057-4583-a391-e6dbf971cd4a", "ip_address": "192.168.99.3"} |
| eea41e01-65ff-4c50-ba6d-92f6f31a6ee6 | | 123f7723b6d64dc59a62dcd1834f4699 | fa:16:3e:76:0f:26 | {"subnet_id": "d0aa19d4-7570-4e36-8772-844141ba62df", "ip_address": "90.0.0.1"} |
| f1a31d63-3b32-428e-a07d-2fcf49d0d63a | | 123f7723b6d64dc59a62dcd1834f4699 | fa:16:3e:3e:f2:a3 | {"subnet_id": "d0aa19d4-7570-4e36-8772-844141ba62df", "ip_address": "90.0.0.2"} |
| fe1989b3-7c83-492e-8592-a5d2e4b3ce4e | | 123f7723b6d64dc59a62dcd1834f4699 | fa:16:3e:0b:7d:32 | {"subnet_id": "b3197718-2057-4583-a391-e6dbf971cd4a", "ip_address": "192.168.99.13"} |
| fed6730a-bd7c-41e3-8321-11092b525968 | | | fa:16:3e:50:46:63 | {"subnet_id": "b171ed59-5ab0-454c-9919-d357fff202ab", "ip_address": "10.0.0.214"} |
+--------------------------------------+------+----------------------------------+-------------------+--------------------------------------------------------------------------------------+
$ nova list
+--------------------------------------+------------------+--------+------------+-------------+----------------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+------------------+--------+------------+-------------+----------------------------------+
| 0fd67810-03d2-4b84-b293-82c805aca274 | vlan1_host0_vm2 | ACTIVE | - | Running | vlan1=90.0.0.12, 10.0.0.214 |
| 9fbf853b-37bd-494a-924a-fe4ad81d1c62 | vlan1_host1_vm1 | ACTIVE | - | Running | vlan1=90.0.0.13, 10.0.0.212 |
| 5d21ed26-711d-4e48-846b-f9c8799b53cf | vxlan1_host0_vm1 | ACTIVE | - | Running | vxlan1=192.168.99.13, 10.0.0.221 |
| a4d3c855-2ec2-4d58-9041-7cae40486f40 | vxlan1_host1_vm2 | ACTIVE | - | Running | vxlan1=192.168.99.7, 10.0.0.223 |
+--------------------------------------+------------------+--------+------------+-------------+----------------------------------+
Ping to VMs on compute-1 is failing. FIP 10.0.0.223, 10.0.0.212
ODL rpm used was scratch 8.3.0.2 available at http://download.eng.bos.redhat.com/brewroot/work/tasks/667/16850667/opendaylight-8.3.0-2.el7ost.noarch.rpm. As per depreciation notice [1], closing this bug. Please reopen if relevant for RHOSP13, as this is the only version shipping ODL. [1] https://access.redhat.com/documentation/en-us/red_hat_openstack_platform/14/html-single/release_notes/index#deprecated_functionality As per depreciation notice [1], closing this bug. Please reopen if relevant for RHOSP13, as this is the only version shipping ODL. [1] https://access.redhat.com/documentation/en-us/red_hat_openstack_platform/14/html-single/release_notes/index#deprecated_functionality |
Created attachment 1454569 [details] karaf logs for all 3 ODL containers Description of problem: Ping to VM on a specific compute node fails when both vlan and vxlan networks are connected to the same router. Version-Release number of selected component (if applicable): How reproducible: Sometimes Steps to Reproduce: Create vlan and vxlan networks. Attach them to a single router. Create 4 VMs, 2 on each compute nodes and attached to each network. Ping their FIPs Actual results: Ping to FIP to VMs on compute nodes fails. Expected results: Ping should not fail. Additional info: This is a HA setup with 3 controllers and 2 computes. PIng to VMs on compute-1 fails. NAPT switch was on compute-1 itself. Some initial analysis: Flow in table=19 is missing. ICMP request reaches to VM but reply is lost at table=19.