Bug 1114583
| Summary: | restarting network service breaks neutron namespaces | ||||||
|---|---|---|---|---|---|---|---|
| Product: | Red Hat OpenStack | Reporter: | yfried | ||||
| Component: | openstack-puppet-modules | Assignee: | Martin Magr <mmagr> | ||||
| Status: | CLOSED ERRATA | QA Contact: | yfried | ||||
| Severity: | urgent | Docs Contact: | |||||
| Priority: | urgent | ||||||
| Version: | 5.0 (RHEL 7) | CC: | adahms, chrisw, jlibosva, lpeer, mmagr, nyechiel, oblaut, sclewis, sgordon, srevivo, yeylon | ||||
| Target Milestone: | rc | Keywords: | Regression | ||||
| Target Release: | 5.0 (RHEL 7) | ||||||
| Hardware: | Unspecified | ||||||
| OS: | Unspecified | ||||||
| Whiteboard: | |||||||
| Fixed In Version: | openstack-puppet-modules-2014.1-18.1.el7ost | Doc Type: | Bug Fix | ||||
| Doc Text: |
This update resolves an issue that would break existing Neutron namespaces when the network service was restarted on a Neutron network node.
|
Story Points: | --- | ||||
| Clone Of: | Environment: | ||||||
| Last Closed: | 2014-07-08 15:39:53 UTC | Type: | Bug | ||||
| Regression: | --- | Mount Type: | --- | ||||
| Documentation: | --- | CRM: | |||||
| Verified Versions: | Category: | --- | |||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||
| Embargoed: | |||||||
| Attachments: |
|
||||||
Setting to o-p-m, regression was introduced by d/s patch of https://review.openstack.org/#/c/94504/ ifcfg-br-ex is still being created and causes qrouter interfaces to disappear. Created attachment 913783 [details]
/var/tmp/packstack
Directory containing logs attached.
I think that some translation of "n" to "false" of config values were introduced in https://review.openstack.org/#/c/79999/12/packstack/plugins/provision_700.py while CONFIG_PROVISION_ALL_IN_ONE_OVS_BRIDGE still compares to "n": https://github.com/stackforge/packstack/blob/master/packstack/plugins/postscript_948.py#L48 Moving back to ON_QA since bug in o-p-m was fixed and issue is now in packstack. Adding to Kuba's comment - The behaviour was not fixed yet, so network service restart would still result in loosing connectivity to external network but this time for another reason as reported in BZ 1115163. This bug can be verified by the fact that br-int br-tun files are not created. The original bug was fixed, still after systemctl restart network.service external connection is lost until systemctl restart neutron-openvswitch-agent.service openstack-packstack-2014.1.1-0.32.1.dev1209.el7ost.noarch 64 bytes from 10.35.180.254: icmp_seq=668 ttl=64 time=1.43 ms From 10.35.180.20 icmp_seq=700 Destination Host Unreachable From 10.35.180.20 icmp_seq=701 Destination Host Unreachable From 10.35.180.20 icmp_seq=702 Destination Host Unreachable From 10.35.180.20 icmp_seq=703 Destination Host Unreachable From 10.35.180.20 icmp_seq=704 Destination Host Unreachable From 10.35.180.20 icmp_seq=705 Destination Host Unreachable From 10.35.180.20 icmp_seq=706 Destination Host Unreachable From 10.35.180.20 icmp_seq=707 Destination Host Unreachable From 10.35.180.20 icmp_seq=708 Destination Host Unreachable From 10.35.180.20 icmp_seq=709 Destination Host Unreachable From 10.35.180.20 icmp_seq=710 Destination Host Unreachable From 10.35.180.20 icmp_seq=711 Destination Host Unreachable From 10.35.180.20 icmp_seq=712 Destination Host Unreachable From 10.35.180.20 icmp_seq=713 Destination Host Unreachable From 10.35.180.20 icmp_seq=714 Destination Host Unreachable From 10.35.180.20 icmp_seq=715 Destination Host Unreachable From 10.35.180.20 icmp_seq=716 Destination Host Unreachable ^C --- 10.35.180.254 ping statistics --- 718 packets transmitted, 668 received, +17 errors, 6% packet loss, time 717919ms rtt min/avg/max/mdev = 0.896/1.818/27.175/2.415 ms, pipe 4 [root@puma04 ~]# systemctl restart neutron-openvswitch-agent.service [root@puma04 ~]# ip net exec qrouter-58c25894-541f-4bcb-afe7-901255ae999a ping 10.35.180.254 PING 10.35.180.254 (10.35.180.254) 56(84) bytes of data. 64 bytes from 10.35.180.254: icmp_seq=1 ttl=64 time=1.15 ms 64 bytes from 10.35.180.254: icmp_seq=2 ttl=64 time=2.42 ms 64 bytes from 10.35.180.254: icmp_seq=3 ttl=64 time=1.12 ms ^C This is caused by interface enp4s0f1.195 disappears from ovs:
[root@puma04 ~(keystone_admin)]# ovs-vsctl show
Bridge br-ex
Port "enp4s0f1.195"
Interface "enp4s0f1.195"
Port phy-br-ex
Interface phy-br-ex
Port br-ex
Interface br-ex
type: internal
Port "qg-6cfc128d-f8"
Interface "qg-6cfc128d-f8"
type: internal
[root@puma04 ~(keystone_admin)]# ovs-ofctl show br-ex
OFPT_FEATURES_REPLY (xid=0x2): dpid:0000009c02b07fe4
n_tables:254, n_buffers:256
capabilities: FLOW_STATS TABLE_STATS PORT_STATS QUEUE_STATS ARP_MATCH_IP
actions: OUTPUT SET_VLAN_VID SET_VLAN_PCP STRIP_VLAN SET_DL_SRC SET_DL_DST SET_NW_SRC SET_NW_DST SET_NW_TOS SET_TP_SRC SET_TP_DST ENQUEUE
3(qg-6cfc128d-f8): addr:00:00:00:00:00:00
config: PORT_DOWN
state: LINK_DOWN
speed: 0 Mbps now, 0 Mbps max
6(phy-br-ex): addr:ee:e4:b1:27:8d:1c
config: 0
state: 0
current: 10GB-FD COPPER
speed: 10000 Mbps now, 0 Mbps max
LOCAL(br-ex): addr:00:9c:02:b0:7f:e4
config: 0
state: 0
speed: 0 Mbps now, 0 Mbps max
OFPT_GET_CONFIG_REPLY (xid=0x4): frags=normal miss_send_len=0
I need to understand whether this is OVS db bug
Tested without NM as well
[root@puma04 ~(keystone_admin_tenant1)]$systemctl restart network.service
Job for network.service failed. See 'systemctl status network.service' and 'journalctl -xn' for details.
[root@puma04 ~(keystone_admin_tenant1)]$systemctl status network.service
network.service - LSB: Bring up/down networking
Loaded: loaded (/etc/rc.d/init.d/network)
Active: failed (Result: exit-code) since Tue 2014-07-08 14:27:12 IDT; 44s ago
Process: 23377 ExecStop=/etc/rc.d/init.d/network stop (code=exited, status=0/SUCCESS)
Process: 23951 ExecStart=/etc/rc.d/init.d/network start (code=exited, status=1/FAILURE)
Jul 08 14:27:08 puma04.scl.lab.tlv.redhat.com dhclient[24111]: DHCPACK from 10.35.160.254 (xid=0x55dfff6f)
Jul 08 14:27:08 puma04.scl.lab.tlv.redhat.com dhclient[24111]: suspect value in domain_name option - discarded
Jul 08 14:27:11 puma04.scl.lab.tlv.redhat.com dhclient[24111]: bound to 10.35.160.17 -- renewal in 17805 seconds.
Jul 08 14:27:11 puma04.scl.lab.tlv.redhat.com network[23951]: Determining IP information for enp4s0f0... done.
Jul 08 14:27:11 puma04.scl.lab.tlv.redhat.com network[23951]: [ OK ]
Jul 08 14:27:11 puma04.scl.lab.tlv.redhat.com network[23951]: Bringing up interface enp4s0f1: Error: either "dev" is duplicate, or "br-ex" is a garbage.
Jul 08 14:27:11 puma04.scl.lab.tlv.redhat.com network[23951]: ERROR : [/etc/sysconfig/network-scripts/ifup-eth] Failed to bring up enp4s0f1
Jul 08 14:27:11 puma04.scl.lab.tlv.redhat.com network[23951]: br-ex.
Jul 08 14:27:11 puma04.scl.lab.tlv.redhat.com network[23951]: [FAILED]
Jul 08 14:27:12 puma04.scl.lab.tlv.redhat.com network[23951]: Bringing up interface enp4s0f1.195: [ OK ]
Jul 08 14:27:12 puma04.scl.lab.tlv.redhat.com systemd[1]: network.service: control process exited, code=exited status=1
Jul 08 14:27:12 puma04.scl.lab.tlv.redhat.com systemd[1]: Failed to start LSB: Bring up/down networking.
Jul 08 14:27:12 puma04.scl.lab.tlv.redhat.com systemd[1]: Unit network.service entered failed state.
[root@puma04 ~(keystone_admin_tenant1)]$
[root@puma04 ~(keystone_admin_tenant1)]$
[root@puma04 ~(keystone_admin_tenant1)]$
[root@puma04 ~(keystone_admin_tenant1)]$
[root@puma04 ~(keystone_admin_tenant1)]$ovs-ofctl show br-ex
OFPT_FEATURES_REPLY (xid=0x2): dpid:0000009c02b07fe4
n_tables:254, n_buffers:256
capabilities: FLOW_STATS TABLE_STATS PORT_STATS QUEUE_STATS ARP_MATCH_IP
actions: OUTPUT SET_VLAN_VID SET_VLAN_PCP STRIP_VLAN SET_DL_SRC SET_DL_DST SET_NW_SRC SET_NW_DST SET_NW_TOS SET_TP_SRC SET_TP_DST ENQUEUE
2(phy-br-ex): addr:22:8d:ca:6a:1d:dc
config: 0
state: 0
current: 10GB-FD COPPER
speed: 10000 Mbps now, 0 Mbps max
3(qg-b982b875-e8): addr:00:00:00:00:00:00
config: PORT_DOWN
state: LINK_DOWN
speed: 0 Mbps now, 0 Mbps max
LOCAL(br-ex): addr:00:9c:02:b0:7f:e4
config: 0
state: 0
speed: 0 Mbps now, 0 Mbps max
OFPT_GET_CONFIG_REPLY (xid=0x4): frags=normal miss_send_len=0
[root@puma04 ~(keystone_admin_tenant1)]$ovs-vsctl show
407266c8-d580-4009-9644-423db5dc5e95
Bridge br-int
Port "qr-6cb20504-4d"
tag: 2
Interface "qr-6cb20504-4d"
type: internal
Port "qr-b8aa6004-00"
tag: 1
Interface "qr-b8aa6004-00"
type: internal
Port int-br-ex
Interface int-br-ex
Port "tap87e02291-9e"
tag: 1
Interface "tap87e02291-9e"
type: internal
Port "int-br-eth3"
Interface "int-br-eth3"
Port patch-tun
Interface patch-tun
type: patch
options: {peer=patch-int}
Port "tap1517905f-76"
tag: 2
Interface "tap1517905f-76"
type: internal
Port br-int
Interface br-int
type: internal
Bridge br-tun
Port patch-int
Interface patch-int
type: patch
options: {peer=patch-tun}
Port "vxlan-37373759"
Interface "vxlan-37373759"
type: vxlan
options: {in_key=flow, local_ip="55.55.55.17", out_key=flow, remote_ip="55.55.55.89"}
Port "vxlan-3737374d"
Interface "vxlan-3737374d"
type: vxlan
options: {in_key=flow, local_ip="55.55.55.17", out_key=flow, remote_ip="55.55.55.77"}
Port "vxlan-37373713"
Interface "vxlan-37373713"
type: vxlan
options: {in_key=flow, local_ip="55.55.55.17", out_key=flow, remote_ip="55.55.55.19"}
Port br-tun
Interface br-tun
type: internal
Bridge "br-eth3"
Port "br-eth3"
Interface "br-eth3"
type: internal
Port "phy-br-eth3"
Interface "phy-br-eth3"
Bridge br-ex
Port br-ex
Interface br-ex
type: internal
Port "enp4s0f1.195"
Interface "enp4s0f1.195"
Port phy-br-ex
Interface phy-br-ex
Port "qg-b982b875-e8"
Interface "qg-b982b875-e8"
type: internal
ovs_version: "2.0.0"
[root@puma04 ~(keystone_admin_tenant1)]$ifconfig | more
br-eth3: flags=67<UP,BROADCAST,RUNNING> mtu 1500
inet6 fe80::4013:b6ff:fe1c:28ec prefixlen 64 scopeid 0x20<link>
ether 12:ca:a3:a4:63:4f txqueuelen 0 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 8 bytes 648 (648.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
br-ex: flags=67<UP,BROADCAST,RUNNING> mtu 1500
inet6 fe80::b0ca:76ff:fe7c:1514 prefixlen 64 scopeid 0x20<link>
ether 00:9c:02:b0:7f:e4 txqueuelen 0 (Ethernet)
RX packets 650 bytes 46524 (45.4 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 8 bytes 648 (648.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
br-int: flags=67<UP,BROADCAST,RUNNING> mtu 1500
inet6 fe80::f8c2:69ff:fe12:371 prefixlen 64 scopeid 0x20<link>
ether 2a:e9:61:6c:80:4e txqueuelen 0 (Ethernet)
RX packets 399 bytes 39042 (38.1 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 8 bytes 648 (648.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
br-tun: flags=67<UP,BROADCAST,RUNNING> mtu 1500
inet6 fe80::7459:11ff:feda:8392 prefixlen 64 scopeid 0x20<link>
ether 66:58:a1:80:93:49 txqueuelen 0 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 8 bytes 648 (648.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
enp4s0f0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 10.35.160.17 netmask 255.255.255.0 broadcast 10.35.160.255
inet6 fe80::29c:2ff:feb0:7fe0 prefixlen 64 scopeid 0x20<link>
ether 00:9c:02:b0:7f:e0 txqueuelen 1000 (Ethernet)
RX packets 3678328 bytes 2616136102 (2.4 GiB)
RX errors 0 dropped 574 overruns 0 frame 0
TX packets 28446842 bytes 40367126903 (37.5 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
enp4s0f1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 55.55.55.17 netmask 255.255.255.0 broadcast 55.55.55.255
inet6 fe80::29c:2ff:feb0:7fe4 prefixlen 64 scopeid 0x20<link>
ether 00:9c:02:b0:7f:e4 txqueuelen 1000 (Ethernet)
RX packets 245859 bytes 16472302 (15.7 MiB)
RX errors 0 dropped 422 overruns 0 frame 0
TX packets 5876 bytes 819932 (800.7 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
enp4s0f1.195: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet6 fe80::29c:2ff:feb0:7fe4 prefixlen 64 scopeid 0x20<link>
ether 00:9c:02:b0:7f:e4 txqueuelen 0 (Ethernet)
RX packets 1 bytes 42 (42.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 8 bytes 648 (648.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
int-br-eth3: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet6 fe80::c404:41ff:fe33:acb0 prefixlen 64 scopeid 0x20<link>
ether c6:04:41:33:ac:b0 txqueuelen 1000 (Ethernet)
RX packets 8 bytes 648 (648.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 407 bytes 39690 (38.7 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
int-br-ex: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet6 fe80::3465:f7ff:fece:5c1f prefixlen 64 scopeid 0x20<link>
ether 36:65:f7:ce:5c:1f txqueuelen 1000 (Ethernet)
RX packets 656 bytes 47038 (45.9 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 407 bytes 39690 (38.7 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10<host>
loop txqueuelen 0 (Local Loopback)
RX packets 1393840 bytes 385979248 (368.0 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 1393840 bytes 385979248 (368.0 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
phy-br-eth3: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet6 fe80::6898:2bff:febb:7835 prefixlen 64 scopeid 0x20<link>
ether 6a:98:2b:bb:78:35 txqueuelen 1000 (Ethernet)
RX packets 407 bytes 39690 (38.7 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 8 bytes 648 (648.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
phy-br-ex: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet6 fe80::208d:caff:fe6a:1ddc prefixlen 64 scopeid 0x20<link>
ether 22:8d:ca:6a:1d:dc txqueuelen 1000 (Ethernet)
RX packets 407 bytes 39690 (38.7 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 656 bytes 47038 (45.9 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. http://rhn.redhat.com/errata/RHEA-2014-0846.html |
restarting network service on neutron network node breaks existing neutron namespace (all NICs disappear, leaving only "lo") New routers are created fine, but without connectivity to network (qdhcp) namespace restarting l3-, dhcp-, openvswitch-, agents restores connectivity to all neutron resources [root@puma04 ~]# rpm -qa | grep "neutron\|packstack" python-neutron-2014.1-35.el7ost.noarch openstack-packstack-puppet-2014.1.1-0.28.dev1194.el7ost.noarch openstack-packstack-doc-2014.1.1-0.28.dev1194.el7ost.noarch openstack-neutron-ml2-2014.1-35.el7ost.noarch openstack-packstack-2014.1.1-0.28.dev1194.el7ost.noarch python-neutronclient-2.3.4-2.el7ost.noarch openstack-neutron-linuxbridge-2014.1-35.el7ost.noarch openstack-neutron-openvswitch-2014.1-35.el7ost.noarch openstack-neutron-2014.1-35.el7ost.noarch openstack-neutron-metering-agent-2014.1-35.el7ost.noarch before network restart: [root@puma04 ~]# ip netns exec qrouter-046aed9c-73b4-4314-aad7-d53f38ba7f72 ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 80: qr-f37a59ca-2a: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN link/ether fa:16:3e:0d:1e:6d brd ff:ff:ff:ff:ff:ff inet 22.0.0.1/24 brd 22.0.0.255 scope global qr-f37a59ca-2a valid_lft forever preferred_lft forever inet6 fe80::f816:3eff:fe0d:1e6d/64 scope link valid_lft forever preferred_lft forever 81: qr-fbd0a035-da: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN link/ether fa:16:3e:3e:55:f3 brd ff:ff:ff:ff:ff:ff inet 21.0.0.1/24 brd 21.0.0.255 scope global qr-fbd0a035-da valid_lft forever preferred_lft forever inet6 fe80::f816:3eff:fe3e:55f3/64 scope link valid_lft forever preferred_lft forever 82: qg-b899fe3a-f4: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN link/ether fa:16:3e:2d:0f:f5 brd ff:ff:ff:ff:ff:ff inet 10.35.180.20/24 brd 10.35.180.255 scope global qg-b899fe3a-f4 valid_lft forever preferred_lft forever inet6 fe80::f816:3eff:fe2d:ff5/64 scope link valid_lft forever preferred_lft forever [root@puma04 ~]# ip netns exec qrouter-046aed9c-73b4-4314-aad7-d53f38ba7f72 ping 21.0.0.3 PING 21.0.0.3 (21.0.0.3) 56(84) bytes of data. 64 bytes from 21.0.0.3: icmp_seq=1 ttl=64 time=0.864 ms [root@puma04 ~]# ip netns exec qrouter-046aed9c-73b4-4314-aad7-d53f38ba7f72 ping 8.8.8.8 PING 8.8.8.8 (8.8.8.8) 56(84) bytes of data. 64 bytes from 8.8.8.8: icmp_seq=1 ttl=43 time=70.7 ms [root@puma04 ~]# systemctl restart network.service [root@puma04 ~]# ovs-vsctl show 34de8d24-f0d8-494a-91f6-f297288de0a3 Bridge "br-eth3" Port "enp4s0f1" Interface "enp4s0f1" Port "br-eth3" Interface "br-eth3" type: internal Bridge br-tun Port br-tun Interface br-tun type: internal Bridge br-int Port br-int Interface br-int type: internal Bridge br-ex Port br-ex Interface br-ex type: internal Port "enp4s0f1.195" Interface "enp4s0f1.195" ovs_version: "2.0.0" [root@puma04 ~]# for ns in `ip netns`; do ip netns exec $ns ip a; done 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever ==> /var/log/neutron/openvswitch-agent.log <== 2014-06-30 15:09:25.729 4508 INFO neutron.agent.securitygroups_rpc [-] Preparing filters for devices set([u'fbd0a035-daa4-48bd-ae6a-1c9c697e33c2']) 2014-06-30 15:09:26.162 4508 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Port fbd0a035-daa4-48bd-ae6a-1c9c697e33c2 updated. Details: {u'admin_state_up': True, u'network_id': u'45737e20-5d27-4a85-b3a5-a968e32806a7', u'segmentation_id': 20000, u'physical_network': None, u'device': u'fbd0a035-daa4-48bd-ae6a-1c9c697e33c2', u'port_id': u'fbd0a035-daa4-48bd-ae6a-1c9c697e33c2', u'network_type': u'vxlan'} 2014-06-30 15:09:26.514 4508 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Configuration for device fbd0a035-daa4-48bd-ae6a-1c9c697e33c2 completed. 2014-06-30 15:10:21.591 4508 ERROR neutron.agent.linux.ovs_lib [-] Unable to execute ['ovs-vsctl', '--timeout=10', 'list-ports', 'br-int']. Exception: Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', 'list-ports', 'br-int'] Exit code: 1 Stdout: '' Stderr: 'ovs-vsctl: no bridge named br-int\n' 2014-06-30 15:10:21.591 4508 ERROR neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Error while processing VIF ports 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Traceback (most recent call last): 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1211, in rpc_loop 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent port_info = self.scan_ports(ports, updated_ports_copy) 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 814, in scan_ports 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent cur_ports = self.int_br.get_vif_port_set() 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 316, in get_vif_port_set 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent port_names = self.get_port_name_list() 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 272, in get_port_name_list 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent res = self.run_vsctl(["list-ports", self.br_name], check_error=True) 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 74, in run_vsctl 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent ctxt.reraise = False 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/openstack/common/excutils.py", line 82, in __exit__ 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent six.reraise(self.type_, self.value, self.tb) 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 67, in run_vsctl 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent return utils.execute(full_args, root_helper=self.root_helper) 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py", line 76, in execute 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent raise RuntimeError(m) 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent RuntimeError: 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', 'list-ports', 'br-int'] 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Exit code: 1 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Stdout: '' 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Stderr: 'ovs-vsctl: no bridge named br-int\n' 2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent 2014-06-30 15:10:23.531 4508 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Agent out of sync with plugin! 2014-06-30 15:10:23.590 4508 ERROR neutron.agent.linux.ovs_lib [-] Unable to execute ['ovs-vsctl', '--timeout=10', 'list-ports', 'br-int']. Exception: Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', 'list-ports', 'br-int'] Exit code: 1 Stdout: '' Stderr: 'ovs-vsctl: no bridge named br-int\n' 2014-06-30 15:10:23.591 4508 ERROR neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Error while processing VIF ports 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Traceback (most recent call last): 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1211, in rpc_loop 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent port_info = self.scan_ports(ports, updated_ports_copy) 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 814, in scan_ports 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent cur_ports = self.int_br.get_vif_port_set() 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 316, in get_vif_port_set 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent port_names = self.get_port_name_list() 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 272, in get_port_name_list 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent res = self.run_vsctl(["list-ports", self.br_name], check_error=True) 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 74, in run_vsctl 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent ctxt.reraise = False 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/openstack/common/excutils.py", line 82, in __exit__ 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent six.reraise(self.type_, self.value, self.tb) 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 67, in run_vsctl 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent return utils.execute(full_args, root_helper=self.root_helper) 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py", line 76, in execute 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent raise RuntimeError(m) 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent RuntimeError: 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', 'list-ports', 'br-int'] 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Exit code: 1 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Stdout: '' 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Stderr: 'ovs-vsctl: no bridge named br-int\n' 2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent 2014-06-30 15:10:25.531 4508 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Agent out of sync with plugin! 2014-06-30 15:10:25.591 4508 ERROR neutron.agent.linux.ovs_lib [-] Unable to execute ['ovs-vsctl', '--timeout=10', 'list-ports', 'br-int']. Exception: Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', 'list-ports', 'br-int'] Exit code: 1 Stdout: '' Stderr: 'ovs-vsctl: no bridge named br-int\n' 2014-06-30 15:10:25.591 4508 ERROR neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Error while processing VIF ports 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Traceback (most recent call last): 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1211, in rpc_loop 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent port_info = self.scan_ports(ports, updated_ports_copy) 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 814, in scan_ports 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent cur_ports = self.int_br.get_vif_port_set() 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 316, in get_vif_port_set 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent port_names = self.get_port_name_list() 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 272, in get_port_name_list 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent res = self.run_vsctl(["list-ports", self.br_name], check_error=True) 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 74, in run_vsctl 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent ctxt.reraise = False 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/openstack/common/excutils.py", line 82, in __exit__ 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent six.reraise(self.type_, self.value, self.tb) 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 67, in run_vsctl 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent return utils.execute(full_args, root_helper=self.root_helper) 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py", line 76, in execute 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent raise RuntimeError(m) 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent RuntimeError: 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', 'list-ports', 'br-int'] 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Exit code: 1 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Stdout: '' 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Stderr: 'ovs-vsctl: no bridge named br-int\n' 2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent 2014-06-30 15:10:27.532 4508 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Agent out of sync with plugin! [root@puma04 ~]# for i in openvswitch l3 dhcp; do systemctl restart neutron-$i-agent.service; done [root@puma04 ~]# for ns in `ip netns`; do ip netns exec $ns ip a; done 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 87: tap0f84c218-79: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN link/ether fa:16:3e:b7:39:cc brd ff:ff:ff:ff:ff:ff inet 22.0.0.3/24 brd 22.0.0.255 scope global tap0f84c218-79 valid_lft forever preferred_lft forever inet6 fe80::f816:3eff:feb7:39cc/64 scope link valid_lft forever preferred_lft forever 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 88: tapacd8ed03-40: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN link/ether fa:16:3e:85:17:28 brd ff:ff:ff:ff:ff:ff inet 21.0.0.3/24 brd 21.0.0.255 scope global tapacd8ed03-40 valid_lft forever preferred_lft forever inet6 fe80::f816:3eff:fe85:1728/64 scope link valid_lft forever preferred_lft forever 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 94: qr-f37a59ca-2a: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN link/ether fa:16:3e:0d:1e:6d brd ff:ff:ff:ff:ff:ff inet 22.0.0.1/24 brd 22.0.0.255 scope global qr-f37a59ca-2a valid_lft forever preferred_lft forever inet6 fe80::f816:3eff:fe0d:1e6d/64 scope link valid_lft forever preferred_lft forever 95: qr-fbd0a035-da: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN link/ether fa:16:3e:3e:55:f3 brd ff:ff:ff:ff:ff:ff inet 21.0.0.1/24 brd 21.0.0.255 scope global qr-fbd0a035-da valid_lft forever preferred_lft forever inet6 fe80::f816:3eff:fe3e:55f3/64 scope link valid_lft forever preferred_lft forever 96: qg-b899fe3a-f4: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN link/ether fa:16:3e:2d:0f:f5 brd ff:ff:ff:ff:ff:ff inet 10.35.180.20/24 brd 10.35.180.255 scope global qg-b899fe3a-f4 valid_lft forever preferred_lft forever inet6 fe80::f816:3eff:fe2d:ff5/64 scope link valid_lft forever preferred_lft forever ==> /var/log/neutron/openvswitch-agent.log <== 2014-06-30 15:13:03.556 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-07ab06e0-2888-4cf3-ad79-b944728852eb None] Agent initialized successfully, now running... 2014-06-30 15:13:03.560 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-07ab06e0-2888-4cf3-ad79-b944728852eb None] Agent out of sync with plugin! 2014-06-30 15:13:03.561 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-07ab06e0-2888-4cf3-ad79-b944728852eb None] Agent tunnel out of sync with plugin! 2014-06-30 15:13:03.571 7460 INFO neutron.openstack.common.rpc.common [req-07ab06e0-2888-4cf3-ad79-b944728852eb None] Connected to AMQP server on 10.35.160.17:5672 2014-06-30 15:13:03.814 7460 INFO neutron.agent.securitygroups_rpc [-] Preparing filters for devices set([u'0f84c218-7991-4bd9-a3a2-f41df6e66480', u'acd8ed03-4051-4334-b001-d8e166473ac7']) 2014-06-30 15:13:04.252 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Port acd8ed03-4051-4334-b001-d8e166473ac7 updated. Details: {u'admin_state_up': True, u'network_id': u'45737e20-5d27-4a85-b3a5-a968e32806a7', u'segmentation_id': 20000, u'physical_network': None, u'device': u'acd8ed03-4051-4334-b001-d8e166473ac7', u'port_id': u'acd8ed03-4051-4334-b001-d8e166473ac7', u'network_type': u'vxlan'} 2014-06-30 15:13:04.252 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Assigning 1 as local vlan for net-id=45737e20-5d27-4a85-b3a5-a968e32806a7 2014-06-30 15:13:04.658 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Configuration for device acd8ed03-4051-4334-b001-d8e166473ac7 completed. 2014-06-30 15:13:04.912 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Port 0f84c218-7991-4bd9-a3a2-f41df6e66480 updated. Details: {u'admin_state_up': True, u'network_id': u'532f755d-c401-4ec7-beba-b2d9f315c3b7', u'segmentation_id': 20001, u'physical_network': None, u'device': u'0f84c218-7991-4bd9-a3a2-f41df6e66480', u'port_id': u'0f84c218-7991-4bd9-a3a2-f41df6e66480', u'network_type': u'vxlan'} 2014-06-30 15:13:04.912 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Assigning 2 as local vlan for net-id=532f755d-c401-4ec7-beba-b2d9f315c3b7 2014-06-30 15:13:05.282 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Configuration for device 0f84c218-7991-4bd9-a3a2-f41df6e66480 completed. 2014-06-30 15:13:05.791 7460 INFO neutron.agent.securitygroups_rpc [-] Preparing filters for devices set([u'f37a59ca-2ab1-4401-843d-2267c040a0bd']) 2014-06-30 15:13:06.234 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Port f37a59ca-2ab1-4401-843d-2267c040a0bd updated. Details: {u'admin_state_up': True, u'network_id': u'532f755d-c401-4ec7-beba-b2d9f315c3b7', u'segmentation_id': 20001, u'physical_network': None, u'device': u'f37a59ca-2ab1-4401-843d-2267c040a0bd', u'port_id': u'f37a59ca-2ab1-4401-843d-2267c040a0bd', u'network_type': u'vxlan'} 2014-06-30 15:13:06.597 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Configuration for device f37a59ca-2ab1-4401-843d-2267c040a0bd completed. 2014-06-30 15:13:07.792 7460 INFO neutron.agent.securitygroups_rpc [-] Preparing filters for devices set([u'fbd0a035-daa4-48bd-ae6a-1c9c697e33c2']) 2014-06-30 15:13:08.208 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Port fbd0a035-daa4-48bd-ae6a-1c9c697e33c2 updated. Details: {u'admin_state_up': True, u'network_id': u'45737e20-5d27-4a85-b3a5-a968e32806a7', u'segmentation_id': 20000, u'physical_network': None, u'device': u'fbd0a035-daa4-48bd-ae6a-1c9c697e33c2', u'port_id': u'fbd0a035-daa4-48bd-ae6a-1c9c697e33c2', u'network_type': u'vxlan'} 2014-06-30 15:13:08.618 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Configuration for device fbd0a035-daa4-48bd-ae6a-1c9c697e33c2 completed. [root@puma04 ~]# ovs-vsctl show 34de8d24-f0d8-494a-91f6-f297288de0a3 Bridge br-tun Port "vxlan-37373759" Interface "vxlan-37373759" type: vxlan options: {in_key=flow, local_ip="55.55.55.17", out_key=flow, remote_ip="55.55.55.89"} Port patch-int Interface patch-int type: patch options: {peer=patch-tun} Port "vxlan-37373713" Interface "vxlan-37373713" type: vxlan options: {in_key=flow, local_ip="55.55.55.17", out_key=flow, remote_ip="55.55.55.19"} Port br-tun Interface br-tun type: internal Port "vxlan-3737374d" Interface "vxlan-3737374d" type: vxlan options: {in_key=flow, local_ip="55.55.55.17", out_key=flow, remote_ip="55.55.55.77"} Bridge "br-eth3" Port "phy-br-eth3" Interface "phy-br-eth3" Port "enp4s0f1" Interface "enp4s0f1" Port "br-eth3" Interface "br-eth3" type: internal Bridge br-int Port br-int Interface br-int type: internal Port "qr-f37a59ca-2a" tag: 2 Interface "qr-f37a59ca-2a" type: internal Port patch-tun Interface patch-tun type: patch options: {peer=patch-int} Port "int-br-eth3" Interface "int-br-eth3" Port "tap0f84c218-79" tag: 2 Interface "tap0f84c218-79" type: internal Port "qr-fbd0a035-da" tag: 1 Interface "qr-fbd0a035-da" type: internal Port "tapacd8ed03-40" tag: 1 Interface "tapacd8ed03-40" type: internal Port int-br-ex Interface int-br-ex Bridge br-ex Port phy-br-ex Interface phy-br-ex Port br-ex Interface br-ex type: internal Port "qg-b899fe3a-f4" Interface "qg-b899fe3a-f4" type: internal Port "enp4s0f1.195" Interface "enp4s0f1.195" ovs_version: "2.0.0"