Bug 1662042
| Summary: | [Netvirt] Floating ip unreachable: port admin_state_up=True while status=DOWN | ||||||
|---|---|---|---|---|---|---|---|
| Product: | Red Hat OpenStack | Reporter: | Noam Manos <nmanos> | ||||
| Component: | opendaylight | Assignee: | Aswin Suryanarayanan <asuryana> | ||||
| Status: | CLOSED WONTFIX | QA Contact: | Noam Manos <nmanos> | ||||
| Severity: | high | Docs Contact: | |||||
| Priority: | medium | ||||||
| Version: | 14.0 (Rocky) | CC: | asuryana, lmarsh, mkolesni, oblaut, sclewis, scohen, supadhya, vpickard | ||||
| Target Milestone: | --- | Keywords: | Triaged, ZStream | ||||
| Target Release: | 14.0 (Rocky) | ||||||
| Hardware: | Unspecified | ||||||
| OS: | Unspecified | ||||||
| Whiteboard: | Netvirt | ||||||
| Fixed In Version: | Doc Type: | Release Note | |||||
| Doc Text: |
OpenDaylight does not support IPv6 for tenant or provider networks. Therefore, use only IPv4 networks. You may experience issues related to floating IPs if IPv6 networks are used along with IPv4 networks.
|
Story Points: | --- | ||||
| Clone Of: | Environment: | ||||||
| Last Closed: | 2019-03-06 16:14:37 UTC | Type: | Bug | ||||
| Regression: | --- | Mount Type: | --- | ||||
| Documentation: | --- | CRM: | |||||
| Verified Versions: | Category: | --- | |||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||
| Embargoed: | |||||||
| Bug Depends On: | |||||||
| Bug Blocks: | 1656091 | ||||||
| Attachments: |
|
||||||
|
Description
Noam Manos
2018-12-25 13:45:46 UTC
The controller fails to ARP the mac of the node(PNF) from which we are pinging the FIP. In the log I could see the below error. 2018-12-26T11:52:27,385 | DEBUG | pool-44-thread-1 | org.opendaylight.netvirt.vpnmanager.SubnetRoutePacketInHandler | SUBNETROUTE: handlePacketToExternalNetwork: Can't find external router with id 4f53e5d4-4132-44fb-8465-bbf12c4fd682 Here 4f53e5d4-4132-44fb-8465-bbf12c4fd682 is the external network Id while it should be the router Id. Created attachment 1518022 [details]
Bug was reproduced on a new OSP14 env - full output + log traces attached.
(overcloud) [stack@undercloud-0 ~]$ openstack server list --all
+--------------------------------------+-------------------+--------+-------------------------------------------------------------+----------+---------------+
| ID | Name | Status | Networks | Image | Flavor |
+--------------------------------------+-------------------+--------+-------------------------------------------------------------+----------+---------------+
| 1fc18c53-d815-4eec-ac0e-0714cf7ba524 | cirros35_vm1_net1 | ACTIVE | net_ipv64_1=10.0.1.6, 2001::f816:3eff:fefc:914a, 10.0.0.211 | cirros35 | cirros_flavor |
+--------------------------------------+-------------------+--------+-------------------------------------------------------------+----------+---------------+
(overcloud) [stack@undercloud-0 ~]$ ping 10.0.0.211
PING 10.0.0.211 (10.0.0.211) 56(84) bytes of data.
^C
--- 10.0.0.211 ping statistics ---
7 packets transmitted, 0 received, 100% packet loss, time 6001ms
The issue is due to the dual stack network associated to the vm. When the we try to ARP for the PNF (undercloud node from where we ping the FIP from), we need the router id to process the ARP which is returned from a list . If an Ipv6 network is associated to the router this list will have both router id and external network id. The code now expects only one element in the list , so when there are more than one it is uses the first entry. If the first entry happens to be the router id the usecase works else it fails. If we use only Ipv4 network we should not be hitting the issue. I can confirm this by running my script without creating IPv6 network and subnet: (overcloud) [stack@undercloud-0 ~]$ openstack server list --all +--------------------------------------+-------------------+--------+-----------------------------------+----------+---------------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+-------------------+--------+-----------------------------------+----------+---------------+ | cc52f18e-29db-49bf-9dfd-090bc7536185 | cirros35_vm1_net1 | ACTIVE | multi_net_1=10.0.1.21, 10.0.0.216 | cirros35 | cirros_flavor | +--------------------------------------+-------------------+--------+-----------------------------------+----------+---------------+ (overcloud) [stack@undercloud-0 ~]$ ping -c 5 10.0.0.216 PING 10.0.0.216 (10.0.0.216) 56(84) bytes of data. 64 bytes from 10.0.0.216: icmp_seq=1 ttl=64 time=2.59 ms 64 bytes from 10.0.0.216: icmp_seq=2 ttl=64 time=0.744 ms 64 bytes from 10.0.0.216: icmp_seq=3 ttl=64 time=0.785 ms 64 bytes from 10.0.0.216: icmp_seq=4 ttl=64 time=0.532 ms 64 bytes from 10.0.0.216: icmp_seq=5 ttl=64 time=0.661 ms --- 10.0.0.216 ping statistics --- 5 packets transmitted, 5 received, 0% packet loss, time 4001ms rtt min/avg/max/mdev = 0.532/1.064/2.599/0.772 ms (overcloud) [stack@undercloud-0 ~]$ openstack server show cc52f18e-29db-49bf-9dfd-090bc7536185 +-------------------------------------+----------------------------------------------------------+ | Field | Value | +-------------------------------------+----------------------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | nova | | OS-EXT-SRV-ATTR:host | compute-1.redhat.local | | OS-EXT-SRV-ATTR:hypervisor_hostname | compute-1.redhat.local | | OS-EXT-SRV-ATTR:instance_name | instance-0000000a | | OS-EXT-STS:power_state | Running | | OS-EXT-STS:task_state | None | | OS-EXT-STS:vm_state | active | | OS-SRV-USG:launched_at | 2019-01-06T15:52:52.000000 | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | multi_net_1=10.0.1.21, 10.0.0.216 | | config_drive | | | created | 2019-01-06T15:52:36Z | | flavor | cirros_flavor (15627900-382b-4533-9d9b-2939f4900a0f) | | hostId | 7fa349bcac6bf07664b798622a8b92fac404ed160e315bc4f059a3d0 | | id | cc52f18e-29db-49bf-9dfd-090bc7536185 | | image | cirros35 (5c16482d-a8e9-43ce-aee4-9267f12d2142) | | key_name | tester-key | | name | cirros35_vm1_net1 | | progress | 0 | | project_id | eb870ce9506f4586b67da3fd11721b54 | | properties | | | security_groups | name='sec_group' | | status | ACTIVE | | updated | 2019-01-06T15:52:52Z | | user_id | 6d92d68d65784c769849397a41ef4b0f | | volumes_attached | | +-------------------------------------+----------------------------------------------------------+ (overcloud) [stack@undercloud-0 ~]$ openstack floating ip list +--------------------------------------+---------------------+------------------+--------------------------------------+--------------------------------------+----------------------------------+ | ID | Floating IP Address | Fixed IP Address | Port | Floating Network | Project | +--------------------------------------+---------------------+------------------+--------------------------------------+--------------------------------------+----------------------------------+ | 8b7e3cbd-72cf-49b4-a215-cc1376d4790b | 10.0.0.216 | 10.0.1.21 | 1edd9bba-b509-4799-955c-bff61f1d427b | a41b4698-8645-420a-841d-d38b1e4d39f7 | eb870ce9506f4586b67da3fd11721b54 | +--------------------------------------+---------------------+------------------+--------------------------------------+--------------------------------------+----------------------------------+ (overcloud) [stack@undercloud-0 ~]$ openstack floating ip show 10.0.0.216 +---------------------+--------------------------------------+ | Field | Value | +---------------------+--------------------------------------+ | created_at | 2019-01-06T15:52:11Z | | description | | | dns_domain | None | | dns_name | None | | fixed_ip_address | 10.0.1.21 | | floating_ip_address | 10.0.0.216 | | floating_network_id | a41b4698-8645-420a-841d-d38b1e4d39f7 | | id | 8b7e3cbd-72cf-49b4-a215-cc1376d4790b | | name | 10.0.0.216 | | port_details | None | | port_id | 1edd9bba-b509-4799-955c-bff61f1d427b | | project_id | eb870ce9506f4586b67da3fd11721b54 | | qos_policy_id | None | | revision_number | 2 | | router_id | 2c173245-902b-44c5-9b3e-f88f850ad7be | | status | ACTIVE | | subnet_id | None | | tags | [] | | updated_at | 2019-01-06T15:53:08Z | +---------------------+--------------------------------------+ (overcloud) [stack@undercloud-0 ~]$ openstack port show 1edd9bba-b509-4799-955c-bff61f1d427b +-----------------------+--------------------------------------------------------------------------+ | Field | Value | +-----------------------+--------------------------------------------------------------------------+ | admin_state_up | UP | | allowed_address_pairs | | | binding_host_id | compute-1.redhat.local | | binding_profile | | | binding_vif_details | | | binding_vif_type | ovs | | binding_vnic_type | normal | | created_at | 2019-01-06T15:52:42Z | | data_plane_status | None | | description | | | device_id | cc52f18e-29db-49bf-9dfd-090bc7536185 | | device_owner | compute:nova | | dns_assignment | None | | dns_domain | None | | dns_name | None | | extra_dhcp_opts | | | fixed_ips | ip_address='10.0.1.21', subnet_id='144a4e77-ca72-42f8-9393-dc0a1b36b41c' | | id | 1edd9bba-b509-4799-955c-bff61f1d427b | | mac_address | fa:16:3e:a6:26:47 | | name | cirros35_vm1_net1_10.0.0.216 | | network_id | 7d789d55-4c4e-4357-b86d-f2918f71ef54 | | port_security_enabled | True | | project_id | eb870ce9506f4586b67da3fd11721b54 | | qos_policy_id | None | | revision_number | 5 | | security_group_ids | 51eae504-38e7-472d-8791-223b24f10f0d | | status | ACTIVE | | tags | | | trunk_details | None | | updated_at | 2019-01-06T15:53:33Z | +-----------------------+--------------------------------------------------------------------------+ As per depreciation notice [1], closing this bug. Please reopen if relevant for RHOSP13, as this is the only version shipping ODL. [1] https://access.redhat.com/documentation/en-us/red_hat_openstack_platform/14/html-single/release_notes/index#deprecated_functionality As per depreciation notice [1], closing this bug. Please reopen if relevant for RHOSP13, as this is the only version shipping ODL. [1] https://access.redhat.com/documentation/en-us/red_hat_openstack_platform/14/html-single/release_notes/index#deprecated_functionality |