Bug 1303769 - L3 external gateway is not updated with L3 HA enabled [NEEDINFO]
Summary: L3 external gateway is not updated with L3 HA enabled
Keywords:
Status: CLOSED DUPLICATE of bug 1253953
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-neutron
Version: 7.0 (Kilo)
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ---
: 7.0 (Kilo)
Assignee: Assaf Muller
QA Contact: Toni Freger
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2016-02-01 22:49 UTC by bigswitch
Modified: 2017-05-08 13:47 UTC (History)
5 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2017-05-08 13:47:11 UTC
Target Upstream Version:
amuller: needinfo? (rhosp-bugs-internal)
amuller: needinfo? (rhosp-bugs-internal)


Attachments (Terms of Use)

Description bigswitch 2016-02-01 22:49:11 UTC
Description of problem:
Deploy RHOSP7 with 7.2 image on three controller. Enable L3_HA on all three controllers.
Create a new tenant/router, and set gateway (gateway must be set first)
Create two network, and attach to router
ping from host to external network is not working. External gateway must be cleared and re-set to show the gateway is updated.
When L3_HA is triggered (by bringing down the active router portgroup), endpoint is still pointing to the previous active controller for external gateway

Version-Release number of selected component (if applicable):
7.2

How reproducible:
100%

Steps to Reproduce:
1. Create tenant/router and set external gateway
2. Create network and attached to router, ping to external is not working
3. Trigger L3 HA failover, neutron port-show on external gateway still points to previous active controller

Actual results:


Expected results:


Additional info:
[root@c5220-01 stack]# neutron router-show P3-Rtr
+-----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Field                 | Value                                                                                                                                                                                  |
+-----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| admin_state_up        | True                                                                                                                                                                                   |
| distributed           | False                                                                                                                                                                                  |
| external_gateway_info | {"network_id": "aee5289f-5ebf-4eb9-b6c1-7a65516590ed", "enable_snat": true, "external_fixed_ips": [{"subnet_id": "9a380763-3b2c-4c9a-924f-051a28f39e39", "ip_address": "10.8.87.17"}]} |
| ha                    | True                                                                                                                                                                                   |
| id                    | 5752b5c6-31e0-42b5-9226-0b6083a9ace3                                                                                                                                                   |
| name                  | P3-Rtr                                                                                                                                                                                 |
| routes                |                                                                                                                                                                                        |
| status                | ACTIVE                                                                                                                                                                                 |
| tenant_id             | 0d24c9d8a9c542068772eb3dafa51e81                                                                                                                                                       |
+-----------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
[root@c5220-01 stack]#


[root@c5220-01 stack]# neutron port-show d4bd4a7c-e25f-42d0-a252-31826e6874de
+-----------------------+-----------------------------------------------------------------------------------+
| Field                 | Value                                                                             |
+-----------------------+-----------------------------------------------------------------------------------+
| admin_state_up        | True                                                                              |
| allowed_address_pairs |                                                                                   |
| binding:host_id       | overcloud-controller-1.localdomain                                                |
| binding:profile       | {}                                                                                |
| binding:vif_details   | {"port_filter": true, "ovs_hybrid_plug": true}                                    |
| binding:vif_type      | ovs                                                                               |
| binding:vnic_type     | normal                                                                            |

| device_id             | 5752b5c6-31e0-42b5-9226-0b6083a9ace3                                              |
| device_owner          | network:router_gateway                                                            |
| extra_dhcp_opts       |                                                                                   |
| fixed_ips             | {"subnet_id": "9a380763-3b2c-4c9a-924f-051a28f39e39", "ip_address": "10.8.87.17"} |
| id                    | d4bd4a7c-e25f-42d0-a252-31826e6874de                                              |
| mac_address           | fa:16:3e:50:df:4e                                                                 |
| name                  |                                                                                   |
| network_id            | aee5289f-5ebf-4eb9-b6c1-7a65516590ed                                              |
| security_groups       |                                                                                   |
| status                | ACTIVE                                                                            |
| tenant_id             |                                                                                   |
+-----------------------+-----------------------------------------------------------------------------------+
[root@c5220-01 stack]#


[root@overcloud-controller-1 heat-admin]# ip netns exec qrouter-5752b5c6-31e0-42b5-9226-0b6083a9ace3 ifconfig
ha-c067136e-73: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 169.254.192.2  netmask 255.255.192.0  broadcast 169.254.255.255
        inet6 fe80::f816:3eff:fe5f:33f1  prefixlen 64  scopeid 0x20<link>
        ether fa:16:3e:5f:33:f1  txqueuelen 1000  (Ethernet)
        RX packets 543  bytes 32816 (32.0 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 15  bytes 1170 (1.1 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 0  (Local Loopback)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

qg-d4bd4a7c-e2: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        ether fa:16:3e:50:df:4e  txqueuelen 1000  (Ethernet)
        RX packets 42  bytes 3150 (3.0 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 2  bytes 188 (188.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

qr-53e79462-53: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        ether fa:16:3e:0e:28:71  txqueuelen 1000  (Ethernet)
        RX packets 502  bytes 37300 (36.4 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 1  bytes 110 (110.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

qr-8dd71da0-bb: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        ether fa:16:3e:8f:55:42  txqueuelen 1000  (Ethernet)
        RX packets 520  bytes 38664 (37.7 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 1  bytes 110 (110.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

[root@overcloud-controller-1 heat-admin]#

[root@overcloud-controller-0 neutron]# ip netns exec qrouter-5752b5c6-31e0-42b5-9226-0b6083a9ace3 ifconfig
ha-6eb0433d-98: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 169.254.192.3  netmask 255.255.192.0  broadcast 169.254.255.255
        inet6 fe80::f816:3eff:fe53:f111  prefixlen 64  scopeid 0x20<link>
        ether fa:16:3e:53:f1:11  txqueuelen 1000  (Ethernet)
        RX packets 33  bytes 2456 (2.3 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 254  bytes 12576 (12.2 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 0  (Local Loopback)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

qg-d4bd4a7c-e2: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 10.8.87.17  netmask 255.255.255.0  broadcast 0.0.0.0
        inet6 fe80::f816:3eff:fe50:df4e  prefixlen 64  scopeid 0x20<link>
        ether fa:16:3e:50:df:4e  txqueuelen 1000  (Ethernet)
        RX packets 480  bytes 25988 (25.3 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 320  bytes 19360 (18.9 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

qr-53e79462-53: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 10.3.2.1  netmask 255.255.255.0  broadcast 0.0.0.0
        inet6 fe80::f816:3eff:fe0e:2871  prefixlen 64  scopeid 0x20<link>
        ether fa:16:3e:0e:28:71  txqueuelen 1000  (Ethernet)
        RX packets 38  bytes 3332 (3.2 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 197  bytes 12898 (12.5 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

qr-8dd71da0-bb: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 10.3.1.1  netmask 255.255.255.0  broadcast 0.0.0.0
        inet6 fe80::f816:3eff:fe8f:5542  prefixlen 64  scopeid 0x20<link>
        ether fa:16:3e:8f:55:42  txqueuelen 1000  (Ethernet)
        RX packets 104  bytes 9698 (9.4 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 274  bytes 21644 (21.1 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

Comment 2 Assaf Muller 2016-06-04 16:23:28 UTC
It sounds like the binding:host_id field for the gateway port is not being updated correctly to point to the node with the active router replica. Can you confirm that you have the fix for https://bugzilla.redhat.com/show_bug.cgi?id=1253953? The fix is in the following package and newer versions: openstack-neutron-2015.1.2-1.el7ost

Comment 3 Assaf Muller 2017-05-08 13:47:11 UTC
Closing this as a duplicate, please re-open if the problem is still relevant.

*** This bug has been marked as a duplicate of bug 1253953 ***


Note You need to log in before you can comment on or make changes to this bug.