Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1114583

Summary: restarting network service breaks neutron namespaces
Product: Red Hat OpenStack Reporter: yfried
Component: openstack-puppet-modulesAssignee: Martin Magr <mmagr>
Status: CLOSED ERRATA QA Contact: yfried
Severity: urgent Docs Contact:
Priority: urgent    
Version: 5.0 (RHEL 7)CC: adahms, chrisw, jlibosva, lpeer, mmagr, nyechiel, oblaut, sclewis, sgordon, srevivo, yeylon
Target Milestone: rcKeywords: Regression
Target Release: 5.0 (RHEL 7)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: openstack-puppet-modules-2014.1-18.1.el7ost Doc Type: Bug Fix
Doc Text:
This update resolves an issue that would break existing Neutron namespaces when the network service was restarted on a Neutron network node.
Story Points: ---
Clone Of: Environment:
Last Closed: 2014-07-08 15:39:53 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
/var/tmp/packstack none

Description yfried 2014-06-30 12:19:45 UTC
restarting network service on neutron network node breaks existing neutron namespace (all NICs disappear, leaving only "lo")

New routers are created fine, but without connectivity to network (qdhcp) namespace

restarting l3-, dhcp-, openvswitch-, agents restores connectivity to all neutron resources

[root@puma04 ~]# rpm -qa | grep "neutron\|packstack"
python-neutron-2014.1-35.el7ost.noarch
openstack-packstack-puppet-2014.1.1-0.28.dev1194.el7ost.noarch
openstack-packstack-doc-2014.1.1-0.28.dev1194.el7ost.noarch
openstack-neutron-ml2-2014.1-35.el7ost.noarch
openstack-packstack-2014.1.1-0.28.dev1194.el7ost.noarch
python-neutronclient-2.3.4-2.el7ost.noarch
openstack-neutron-linuxbridge-2014.1-35.el7ost.noarch
openstack-neutron-openvswitch-2014.1-35.el7ost.noarch
openstack-neutron-2014.1-35.el7ost.noarch
openstack-neutron-metering-agent-2014.1-35.el7ost.noarch

before network restart:
[root@puma04 ~]# ip netns exec qrouter-046aed9c-73b4-4314-aad7-d53f38ba7f72 ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
80: qr-f37a59ca-2a: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN 
    link/ether fa:16:3e:0d:1e:6d brd ff:ff:ff:ff:ff:ff
    inet 22.0.0.1/24 brd 22.0.0.255 scope global qr-f37a59ca-2a
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fe0d:1e6d/64 scope link 
       valid_lft forever preferred_lft forever
81: qr-fbd0a035-da: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN 
    link/ether fa:16:3e:3e:55:f3 brd ff:ff:ff:ff:ff:ff
    inet 21.0.0.1/24 brd 21.0.0.255 scope global qr-fbd0a035-da
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fe3e:55f3/64 scope link 
       valid_lft forever preferred_lft forever
82: qg-b899fe3a-f4: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN 
    link/ether fa:16:3e:2d:0f:f5 brd ff:ff:ff:ff:ff:ff
    inet 10.35.180.20/24 brd 10.35.180.255 scope global qg-b899fe3a-f4
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fe2d:ff5/64 scope link 
       valid_lft forever preferred_lft forever


[root@puma04 ~]# ip netns exec qrouter-046aed9c-73b4-4314-aad7-d53f38ba7f72 ping 21.0.0.3
PING 21.0.0.3 (21.0.0.3) 56(84) bytes of data.
64 bytes from 21.0.0.3: icmp_seq=1 ttl=64 time=0.864 ms

[root@puma04 ~]# ip netns exec qrouter-046aed9c-73b4-4314-aad7-d53f38ba7f72 ping 8.8.8.8
PING 8.8.8.8 (8.8.8.8) 56(84) bytes of data.
64 bytes from 8.8.8.8: icmp_seq=1 ttl=43 time=70.7 ms


[root@puma04 ~]# systemctl restart network.service 

[root@puma04 ~]# ovs-vsctl show
34de8d24-f0d8-494a-91f6-f297288de0a3
    Bridge "br-eth3"
        Port "enp4s0f1"
            Interface "enp4s0f1"
        Port "br-eth3"
            Interface "br-eth3"
                type: internal
    Bridge br-tun
        Port br-tun
            Interface br-tun
                type: internal
    Bridge br-int
        Port br-int
            Interface br-int
                type: internal
    Bridge br-ex
        Port br-ex
            Interface br-ex
                type: internal
        Port "enp4s0f1.195"
            Interface "enp4s0f1.195"
    ovs_version: "2.0.0"

[root@puma04 ~]# for ns in `ip netns`; do ip netns exec $ns ip a; done
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever


==> /var/log/neutron/openvswitch-agent.log <==
2014-06-30 15:09:25.729 4508 INFO neutron.agent.securitygroups_rpc [-] Preparing filters for devices set([u'fbd0a035-daa4-48bd-ae6a-1c9c697e33c2'])
2014-06-30 15:09:26.162 4508 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Port fbd0a035-daa4-48bd-ae6a-1c9c697e33c2 updated. Details: {u'admin_state_up': True, u'network_id': u'45737e20-5d27-4a85-b3a5-a968e32806a7', u'segmentation_id': 20000, u'physical_network': None, u'device': u'fbd0a035-daa4-48bd-ae6a-1c9c697e33c2', u'port_id': u'fbd0a035-daa4-48bd-ae6a-1c9c697e33c2', u'network_type': u'vxlan'}
2014-06-30 15:09:26.514 4508 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Configuration for device fbd0a035-daa4-48bd-ae6a-1c9c697e33c2 completed.
2014-06-30 15:10:21.591 4508 ERROR neutron.agent.linux.ovs_lib [-] Unable to execute ['ovs-vsctl', '--timeout=10', 'list-ports', 'br-int']. Exception: 
Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', 'list-ports', 'br-int']
Exit code: 1
Stdout: ''
Stderr: 'ovs-vsctl: no bridge named br-int\n'
2014-06-30 15:10:21.591 4508 ERROR neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Error while processing VIF ports
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Traceback (most recent call last):
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1211, in rpc_loop
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_info = self.scan_ports(ports, updated_ports_copy)
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 814, in scan_ports
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     cur_ports = self.int_br.get_vif_port_set()
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 316, in get_vif_port_set
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_names = self.get_port_name_list()
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 272, in get_port_name_list
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     res = self.run_vsctl(["list-ports", self.br_name], check_error=True)
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 74, in run_vsctl
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     ctxt.reraise = False
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/openstack/common/excutils.py", line 82, in __exit__
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     six.reraise(self.type_, self.value, self.tb)
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 67, in run_vsctl
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     return utils.execute(full_args, root_helper=self.root_helper)
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py", line 76, in execute
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     raise RuntimeError(m)
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent RuntimeError: 
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', 'list-ports', 'br-int']
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Exit code: 1
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Stdout: ''
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Stderr: 'ovs-vsctl: no bridge named br-int\n'
2014-06-30 15:10:21.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent 
2014-06-30 15:10:23.531 4508 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Agent out of sync with plugin!
2014-06-30 15:10:23.590 4508 ERROR neutron.agent.linux.ovs_lib [-] Unable to execute ['ovs-vsctl', '--timeout=10', 'list-ports', 'br-int']. Exception: 
Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', 'list-ports', 'br-int']
Exit code: 1
Stdout: ''
Stderr: 'ovs-vsctl: no bridge named br-int\n'
2014-06-30 15:10:23.591 4508 ERROR neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Error while processing VIF ports
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Traceback (most recent call last):
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1211, in rpc_loop
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_info = self.scan_ports(ports, updated_ports_copy)
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 814, in scan_ports
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     cur_ports = self.int_br.get_vif_port_set()
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 316, in get_vif_port_set
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_names = self.get_port_name_list()
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 272, in get_port_name_list
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     res = self.run_vsctl(["list-ports", self.br_name], check_error=True)
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 74, in run_vsctl
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     ctxt.reraise = False
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/openstack/common/excutils.py", line 82, in __exit__
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     six.reraise(self.type_, self.value, self.tb)
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 67, in run_vsctl
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     return utils.execute(full_args, root_helper=self.root_helper)
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py", line 76, in execute
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     raise RuntimeError(m)
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent RuntimeError: 
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', 'list-ports', 'br-int']
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Exit code: 1
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Stdout: ''
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Stderr: 'ovs-vsctl: no bridge named br-int\n'
2014-06-30 15:10:23.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent 
2014-06-30 15:10:25.531 4508 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Agent out of sync with plugin!
2014-06-30 15:10:25.591 4508 ERROR neutron.agent.linux.ovs_lib [-] Unable to execute ['ovs-vsctl', '--timeout=10', 'list-ports', 'br-int']. Exception: 
Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', 'list-ports', 'br-int']
Exit code: 1
Stdout: ''
Stderr: 'ovs-vsctl: no bridge named br-int\n'
2014-06-30 15:10:25.591 4508 ERROR neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Error while processing VIF ports
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Traceback (most recent call last):
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1211, in rpc_loop
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_info = self.scan_ports(ports, updated_ports_copy)
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 814, in scan_ports
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     cur_ports = self.int_br.get_vif_port_set()
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 316, in get_vif_port_set
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_names = self.get_port_name_list()
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 272, in get_port_name_list
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     res = self.run_vsctl(["list-ports", self.br_name], check_error=True)
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 74, in run_vsctl
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     ctxt.reraise = False
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/openstack/common/excutils.py", line 82, in __exit__
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     six.reraise(self.type_, self.value, self.tb)
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/ovs_lib.py", line 67, in run_vsctl
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     return utils.execute(full_args, root_helper=self.root_helper)
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/utils.py", line 76, in execute
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     raise RuntimeError(m)
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent RuntimeError: 
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', 'list-ports', 'br-int']
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Exit code: 1
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Stdout: ''
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Stderr: 'ovs-vsctl: no bridge named br-int\n'
2014-06-30 15:10:25.591 4508 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent 
2014-06-30 15:10:27.532 4508 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Agent out of sync with plugin!


[root@puma04 ~]# for i in openvswitch l3 dhcp; do systemctl restart neutron-$i-agent.service; done
[root@puma04 ~]# for ns in `ip netns`; do ip netns exec $ns ip a; done
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
87: tap0f84c218-79: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN 
    link/ether fa:16:3e:b7:39:cc brd ff:ff:ff:ff:ff:ff
    inet 22.0.0.3/24 brd 22.0.0.255 scope global tap0f84c218-79
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:feb7:39cc/64 scope link 
       valid_lft forever preferred_lft forever
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
88: tapacd8ed03-40: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN 
    link/ether fa:16:3e:85:17:28 brd ff:ff:ff:ff:ff:ff
    inet 21.0.0.3/24 brd 21.0.0.255 scope global tapacd8ed03-40
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fe85:1728/64 scope link 
       valid_lft forever preferred_lft forever
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
94: qr-f37a59ca-2a: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN 
    link/ether fa:16:3e:0d:1e:6d brd ff:ff:ff:ff:ff:ff
    inet 22.0.0.1/24 brd 22.0.0.255 scope global qr-f37a59ca-2a
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fe0d:1e6d/64 scope link 
       valid_lft forever preferred_lft forever
95: qr-fbd0a035-da: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN 
    link/ether fa:16:3e:3e:55:f3 brd ff:ff:ff:ff:ff:ff
    inet 21.0.0.1/24 brd 21.0.0.255 scope global qr-fbd0a035-da
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fe3e:55f3/64 scope link 
       valid_lft forever preferred_lft forever
96: qg-b899fe3a-f4: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN 
    link/ether fa:16:3e:2d:0f:f5 brd ff:ff:ff:ff:ff:ff
    inet 10.35.180.20/24 brd 10.35.180.255 scope global qg-b899fe3a-f4
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fe2d:ff5/64 scope link 
       valid_lft forever preferred_lft forever


==> /var/log/neutron/openvswitch-agent.log <==
2014-06-30 15:13:03.556 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-07ab06e0-2888-4cf3-ad79-b944728852eb None] Agent initialized successfully, now running... 
2014-06-30 15:13:03.560 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-07ab06e0-2888-4cf3-ad79-b944728852eb None] Agent out of sync with plugin!
2014-06-30 15:13:03.561 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-07ab06e0-2888-4cf3-ad79-b944728852eb None] Agent tunnel out of sync with plugin!
2014-06-30 15:13:03.571 7460 INFO neutron.openstack.common.rpc.common [req-07ab06e0-2888-4cf3-ad79-b944728852eb None] Connected to AMQP server on 10.35.160.17:5672
2014-06-30 15:13:03.814 7460 INFO neutron.agent.securitygroups_rpc [-] Preparing filters for devices set([u'0f84c218-7991-4bd9-a3a2-f41df6e66480', u'acd8ed03-4051-4334-b001-d8e166473ac7'])
2014-06-30 15:13:04.252 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Port acd8ed03-4051-4334-b001-d8e166473ac7 updated. Details: {u'admin_state_up': True, u'network_id': u'45737e20-5d27-4a85-b3a5-a968e32806a7', u'segmentation_id': 20000, u'physical_network': None, u'device': u'acd8ed03-4051-4334-b001-d8e166473ac7', u'port_id': u'acd8ed03-4051-4334-b001-d8e166473ac7', u'network_type': u'vxlan'}
2014-06-30 15:13:04.252 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Assigning 1 as local vlan for net-id=45737e20-5d27-4a85-b3a5-a968e32806a7
2014-06-30 15:13:04.658 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Configuration for device acd8ed03-4051-4334-b001-d8e166473ac7 completed.
2014-06-30 15:13:04.912 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Port 0f84c218-7991-4bd9-a3a2-f41df6e66480 updated. Details: {u'admin_state_up': True, u'network_id': u'532f755d-c401-4ec7-beba-b2d9f315c3b7', u'segmentation_id': 20001, u'physical_network': None, u'device': u'0f84c218-7991-4bd9-a3a2-f41df6e66480', u'port_id': u'0f84c218-7991-4bd9-a3a2-f41df6e66480', u'network_type': u'vxlan'}
2014-06-30 15:13:04.912 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Assigning 2 as local vlan for net-id=532f755d-c401-4ec7-beba-b2d9f315c3b7
2014-06-30 15:13:05.282 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Configuration for device 0f84c218-7991-4bd9-a3a2-f41df6e66480 completed.
2014-06-30 15:13:05.791 7460 INFO neutron.agent.securitygroups_rpc [-] Preparing filters for devices set([u'f37a59ca-2ab1-4401-843d-2267c040a0bd'])
2014-06-30 15:13:06.234 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Port f37a59ca-2ab1-4401-843d-2267c040a0bd updated. Details: {u'admin_state_up': True, u'network_id': u'532f755d-c401-4ec7-beba-b2d9f315c3b7', u'segmentation_id': 20001, u'physical_network': None, u'device': u'f37a59ca-2ab1-4401-843d-2267c040a0bd', u'port_id': u'f37a59ca-2ab1-4401-843d-2267c040a0bd', u'network_type': u'vxlan'}
2014-06-30 15:13:06.597 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Configuration for device f37a59ca-2ab1-4401-843d-2267c040a0bd completed.
2014-06-30 15:13:07.792 7460 INFO neutron.agent.securitygroups_rpc [-] Preparing filters for devices set([u'fbd0a035-daa4-48bd-ae6a-1c9c697e33c2'])
2014-06-30 15:13:08.208 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Port fbd0a035-daa4-48bd-ae6a-1c9c697e33c2 updated. Details: {u'admin_state_up': True, u'network_id': u'45737e20-5d27-4a85-b3a5-a968e32806a7', u'segmentation_id': 20000, u'physical_network': None, u'device': u'fbd0a035-daa4-48bd-ae6a-1c9c697e33c2', u'port_id': u'fbd0a035-daa4-48bd-ae6a-1c9c697e33c2', u'network_type': u'vxlan'}
2014-06-30 15:13:08.618 7460 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Configuration for device fbd0a035-daa4-48bd-ae6a-1c9c697e33c2 completed.

[root@puma04 ~]# ovs-vsctl show
34de8d24-f0d8-494a-91f6-f297288de0a3
    Bridge br-tun
        Port "vxlan-37373759"
            Interface "vxlan-37373759"
                type: vxlan
                options: {in_key=flow, local_ip="55.55.55.17", out_key=flow, remote_ip="55.55.55.89"}
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port "vxlan-37373713"
            Interface "vxlan-37373713"
                type: vxlan
                options: {in_key=flow, local_ip="55.55.55.17", out_key=flow, remote_ip="55.55.55.19"}
        Port br-tun
            Interface br-tun
                type: internal
        Port "vxlan-3737374d"
            Interface "vxlan-3737374d"
                type: vxlan
                options: {in_key=flow, local_ip="55.55.55.17", out_key=flow, remote_ip="55.55.55.77"}
    Bridge "br-eth3"
        Port "phy-br-eth3"
            Interface "phy-br-eth3"
        Port "enp4s0f1"
            Interface "enp4s0f1"
        Port "br-eth3"
            Interface "br-eth3"
                type: internal
    Bridge br-int
        Port br-int
            Interface br-int
                type: internal
        Port "qr-f37a59ca-2a"
            tag: 2
            Interface "qr-f37a59ca-2a"
                type: internal
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port "int-br-eth3"
            Interface "int-br-eth3"
        Port "tap0f84c218-79"
            tag: 2
            Interface "tap0f84c218-79"
                type: internal
        Port "qr-fbd0a035-da"
            tag: 1
            Interface "qr-fbd0a035-da"
                type: internal
        Port "tapacd8ed03-40"
            tag: 1
            Interface "tapacd8ed03-40"
                type: internal
        Port int-br-ex
            Interface int-br-ex
    Bridge br-ex
        Port phy-br-ex
            Interface phy-br-ex
        Port br-ex
            Interface br-ex
                type: internal
        Port "qg-b899fe3a-f4"
            Interface "qg-b899fe3a-f4"
                type: internal
        Port "enp4s0f1.195"
            Interface "enp4s0f1.195"
    ovs_version: "2.0.0"

Comment 2 Jakub Libosvar 2014-06-30 16:00:48 UTC
Setting to o-p-m, regression was introduced by d/s patch of https://review.openstack.org/#/c/94504/

Comment 4 Jakub Libosvar 2014-07-01 14:47:50 UTC
ifcfg-br-ex is still being created and causes qrouter interfaces to disappear.

Comment 5 Jakub Libosvar 2014-07-01 14:52:03 UTC
Created attachment 913783 [details]
/var/tmp/packstack

Directory containing logs attached.

Comment 6 Jakub Libosvar 2014-07-01 18:06:31 UTC
I think that some translation of "n" to "false" of config values were introduced in https://review.openstack.org/#/c/79999/12/packstack/plugins/provision_700.py while CONFIG_PROVISION_ALL_IN_ONE_OVS_BRIDGE still compares to "n": https://github.com/stackforge/packstack/blob/master/packstack/plugins/postscript_948.py#L48

Comment 7 Jakub Libosvar 2014-07-01 18:11:02 UTC
Moving back to ON_QA since bug in o-p-m was fixed and issue is now in packstack.

Comment 8 lpeer 2014-07-01 18:20:55 UTC
Adding to Kuba's comment -

The behaviour was not fixed yet, so network service restart would still result in loosing connectivity to external network but this time for another reason as reported in BZ 1115163.

This bug can be verified by the fact that br-int br-tun files are not created.

Comment 11 Ofer Blaut 2014-07-06 07:23:17 UTC
The original bug was fixed, still  after systemctl restart network.service  
external connection is lost until systemctl restart neutron-openvswitch-agent.service 


openstack-packstack-2014.1.1-0.32.1.dev1209.el7ost.noarch


64 bytes from 10.35.180.254: icmp_seq=668 ttl=64 time=1.43 ms
From 10.35.180.20 icmp_seq=700 Destination Host Unreachable
From 10.35.180.20 icmp_seq=701 Destination Host Unreachable
From 10.35.180.20 icmp_seq=702 Destination Host Unreachable
From 10.35.180.20 icmp_seq=703 Destination Host Unreachable
From 10.35.180.20 icmp_seq=704 Destination Host Unreachable
From 10.35.180.20 icmp_seq=705 Destination Host Unreachable
From 10.35.180.20 icmp_seq=706 Destination Host Unreachable
From 10.35.180.20 icmp_seq=707 Destination Host Unreachable
From 10.35.180.20 icmp_seq=708 Destination Host Unreachable
From 10.35.180.20 icmp_seq=709 Destination Host Unreachable
From 10.35.180.20 icmp_seq=710 Destination Host Unreachable
From 10.35.180.20 icmp_seq=711 Destination Host Unreachable
From 10.35.180.20 icmp_seq=712 Destination Host Unreachable
From 10.35.180.20 icmp_seq=713 Destination Host Unreachable
From 10.35.180.20 icmp_seq=714 Destination Host Unreachable
From 10.35.180.20 icmp_seq=715 Destination Host Unreachable
From 10.35.180.20 icmp_seq=716 Destination Host Unreachable
^C
--- 10.35.180.254 ping statistics ---
718 packets transmitted, 668 received, +17 errors, 6% packet loss, time 717919ms
rtt min/avg/max/mdev = 0.896/1.818/27.175/2.415 ms, pipe 4
[root@puma04 ~]# systemctl restart neutron-openvswitch-agent.service 
[root@puma04 ~]# ip net exec qrouter-58c25894-541f-4bcb-afe7-901255ae999a ping 10.35.180.254
PING 10.35.180.254 (10.35.180.254) 56(84) bytes of data.
64 bytes from 10.35.180.254: icmp_seq=1 ttl=64 time=1.15 ms
64 bytes from 10.35.180.254: icmp_seq=2 ttl=64 time=2.42 ms
64 bytes from 10.35.180.254: icmp_seq=3 ttl=64 time=1.12 ms
^C

Comment 13 Jakub Libosvar 2014-07-07 14:59:11 UTC
This is caused by interface enp4s0f1.195 disappears from ovs:
[root@puma04 ~(keystone_admin)]# ovs-vsctl show
    Bridge br-ex
        Port "enp4s0f1.195"
            Interface "enp4s0f1.195"
        Port phy-br-ex
            Interface phy-br-ex
        Port br-ex
            Interface br-ex
                type: internal
        Port "qg-6cfc128d-f8"
            Interface "qg-6cfc128d-f8"
                type: internal

[root@puma04 ~(keystone_admin)]# ovs-ofctl show br-ex
OFPT_FEATURES_REPLY (xid=0x2): dpid:0000009c02b07fe4
n_tables:254, n_buffers:256
capabilities: FLOW_STATS TABLE_STATS PORT_STATS QUEUE_STATS ARP_MATCH_IP
actions: OUTPUT SET_VLAN_VID SET_VLAN_PCP STRIP_VLAN SET_DL_SRC SET_DL_DST SET_NW_SRC SET_NW_DST SET_NW_TOS SET_TP_SRC SET_TP_DST ENQUEUE
 3(qg-6cfc128d-f8): addr:00:00:00:00:00:00
     config:     PORT_DOWN
     state:      LINK_DOWN
     speed: 0 Mbps now, 0 Mbps max
 6(phy-br-ex): addr:ee:e4:b1:27:8d:1c
     config:     0
     state:      0
     current:    10GB-FD COPPER
     speed: 10000 Mbps now, 0 Mbps max
 LOCAL(br-ex): addr:00:9c:02:b0:7f:e4
     config:     0
     state:      0
     speed: 0 Mbps now, 0 Mbps max
OFPT_GET_CONFIG_REPLY (xid=0x4): frags=normal miss_send_len=0

I need to understand whether this is OVS db bug

Comment 14 Ofer Blaut 2014-07-08 11:33:50 UTC
Tested without NM as well


[root@puma04 ~(keystone_admin_tenant1)]$systemctl restart network.service 
Job for network.service failed. See 'systemctl status network.service' and 'journalctl -xn' for details.
[root@puma04 ~(keystone_admin_tenant1)]$systemctl status network.service
network.service - LSB: Bring up/down networking
   Loaded: loaded (/etc/rc.d/init.d/network)
   Active: failed (Result: exit-code) since Tue 2014-07-08 14:27:12 IDT; 44s ago
  Process: 23377 ExecStop=/etc/rc.d/init.d/network stop (code=exited, status=0/SUCCESS)
  Process: 23951 ExecStart=/etc/rc.d/init.d/network start (code=exited, status=1/FAILURE)

Jul 08 14:27:08 puma04.scl.lab.tlv.redhat.com dhclient[24111]: DHCPACK from 10.35.160.254 (xid=0x55dfff6f)
Jul 08 14:27:08 puma04.scl.lab.tlv.redhat.com dhclient[24111]: suspect value in domain_name option - discarded
Jul 08 14:27:11 puma04.scl.lab.tlv.redhat.com dhclient[24111]: bound to 10.35.160.17 -- renewal in 17805 seconds.
Jul 08 14:27:11 puma04.scl.lab.tlv.redhat.com network[23951]: Determining IP information for enp4s0f0... done.
Jul 08 14:27:11 puma04.scl.lab.tlv.redhat.com network[23951]: [  OK  ]
Jul 08 14:27:11 puma04.scl.lab.tlv.redhat.com network[23951]: Bringing up interface enp4s0f1:  Error: either "dev" is duplicate, or "br-ex" is a garbage.
Jul 08 14:27:11 puma04.scl.lab.tlv.redhat.com network[23951]: ERROR    : [/etc/sysconfig/network-scripts/ifup-eth] Failed to bring up enp4s0f1
Jul 08 14:27:11 puma04.scl.lab.tlv.redhat.com network[23951]: br-ex.
Jul 08 14:27:11 puma04.scl.lab.tlv.redhat.com network[23951]: [FAILED]
Jul 08 14:27:12 puma04.scl.lab.tlv.redhat.com network[23951]: Bringing up interface enp4s0f1.195:  [  OK  ]
Jul 08 14:27:12 puma04.scl.lab.tlv.redhat.com systemd[1]: network.service: control process exited, code=exited status=1
Jul 08 14:27:12 puma04.scl.lab.tlv.redhat.com systemd[1]: Failed to start LSB: Bring up/down networking.
Jul 08 14:27:12 puma04.scl.lab.tlv.redhat.com systemd[1]: Unit network.service entered failed state.
[root@puma04 ~(keystone_admin_tenant1)]$
[root@puma04 ~(keystone_admin_tenant1)]$
[root@puma04 ~(keystone_admin_tenant1)]$
[root@puma04 ~(keystone_admin_tenant1)]$
[root@puma04 ~(keystone_admin_tenant1)]$ovs-ofctl show br-ex
OFPT_FEATURES_REPLY (xid=0x2): dpid:0000009c02b07fe4
n_tables:254, n_buffers:256
capabilities: FLOW_STATS TABLE_STATS PORT_STATS QUEUE_STATS ARP_MATCH_IP
actions: OUTPUT SET_VLAN_VID SET_VLAN_PCP STRIP_VLAN SET_DL_SRC SET_DL_DST SET_NW_SRC SET_NW_DST SET_NW_TOS SET_TP_SRC SET_TP_DST ENQUEUE
 2(phy-br-ex): addr:22:8d:ca:6a:1d:dc
     config:     0
     state:      0
     current:    10GB-FD COPPER
     speed: 10000 Mbps now, 0 Mbps max
 3(qg-b982b875-e8): addr:00:00:00:00:00:00
     config:     PORT_DOWN
     state:      LINK_DOWN
     speed: 0 Mbps now, 0 Mbps max
 LOCAL(br-ex): addr:00:9c:02:b0:7f:e4
     config:     0
     state:      0
     speed: 0 Mbps now, 0 Mbps max
OFPT_GET_CONFIG_REPLY (xid=0x4): frags=normal miss_send_len=0
[root@puma04 ~(keystone_admin_tenant1)]$ovs-vsctl show
407266c8-d580-4009-9644-423db5dc5e95
    Bridge br-int
        Port "qr-6cb20504-4d"
            tag: 2
            Interface "qr-6cb20504-4d"
                type: internal
        Port "qr-b8aa6004-00"
            tag: 1
            Interface "qr-b8aa6004-00"
                type: internal
        Port int-br-ex
            Interface int-br-ex
        Port "tap87e02291-9e"
            tag: 1
            Interface "tap87e02291-9e"
                type: internal
        Port "int-br-eth3"
            Interface "int-br-eth3"
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port "tap1517905f-76"
            tag: 2
            Interface "tap1517905f-76"
                type: internal
        Port br-int
            Interface br-int
                type: internal
    Bridge br-tun
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port "vxlan-37373759"
            Interface "vxlan-37373759"
                type: vxlan
                options: {in_key=flow, local_ip="55.55.55.17", out_key=flow, remote_ip="55.55.55.89"}
        Port "vxlan-3737374d"
            Interface "vxlan-3737374d"
                type: vxlan
                options: {in_key=flow, local_ip="55.55.55.17", out_key=flow, remote_ip="55.55.55.77"}
        Port "vxlan-37373713"
            Interface "vxlan-37373713"
                type: vxlan
                options: {in_key=flow, local_ip="55.55.55.17", out_key=flow, remote_ip="55.55.55.19"}
        Port br-tun
            Interface br-tun
                type: internal
    Bridge "br-eth3"
        Port "br-eth3"
            Interface "br-eth3"
                type: internal
        Port "phy-br-eth3"
            Interface "phy-br-eth3"
    Bridge br-ex
        Port br-ex
            Interface br-ex
                type: internal
        Port "enp4s0f1.195"
            Interface "enp4s0f1.195"
        Port phy-br-ex
            Interface phy-br-ex
        Port "qg-b982b875-e8"
            Interface "qg-b982b875-e8"
                type: internal
    ovs_version: "2.0.0"
[root@puma04 ~(keystone_admin_tenant1)]$ifconfig | more
br-eth3: flags=67<UP,BROADCAST,RUNNING>  mtu 1500
        inet6 fe80::4013:b6ff:fe1c:28ec  prefixlen 64  scopeid 0x20<link>
        ether 12:ca:a3:a4:63:4f  txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 8  bytes 648 (648.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

br-ex: flags=67<UP,BROADCAST,RUNNING>  mtu 1500
        inet6 fe80::b0ca:76ff:fe7c:1514  prefixlen 64  scopeid 0x20<link>
        ether 00:9c:02:b0:7f:e4  txqueuelen 0  (Ethernet)
        RX packets 650  bytes 46524 (45.4 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 8  bytes 648 (648.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

br-int: flags=67<UP,BROADCAST,RUNNING>  mtu 1500
        inet6 fe80::f8c2:69ff:fe12:371  prefixlen 64  scopeid 0x20<link>
        ether 2a:e9:61:6c:80:4e  txqueuelen 0  (Ethernet)
        RX packets 399  bytes 39042 (38.1 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 8  bytes 648 (648.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

br-tun: flags=67<UP,BROADCAST,RUNNING>  mtu 1500
        inet6 fe80::7459:11ff:feda:8392  prefixlen 64  scopeid 0x20<link>
        ether 66:58:a1:80:93:49  txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 8  bytes 648 (648.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

enp4s0f0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 10.35.160.17  netmask 255.255.255.0  broadcast 10.35.160.255
        inet6 fe80::29c:2ff:feb0:7fe0  prefixlen 64  scopeid 0x20<link>
        ether 00:9c:02:b0:7f:e0  txqueuelen 1000  (Ethernet)
        RX packets 3678328  bytes 2616136102 (2.4 GiB)
        RX errors 0  dropped 574  overruns 0  frame 0
        TX packets 28446842  bytes 40367126903 (37.5 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

enp4s0f1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 55.55.55.17  netmask 255.255.255.0  broadcast 55.55.55.255
        inet6 fe80::29c:2ff:feb0:7fe4  prefixlen 64  scopeid 0x20<link>
        ether 00:9c:02:b0:7f:e4  txqueuelen 1000  (Ethernet)
        RX packets 245859  bytes 16472302 (15.7 MiB)
        RX errors 0  dropped 422  overruns 0  frame 0
        TX packets 5876  bytes 819932 (800.7 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

enp4s0f1.195: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet6 fe80::29c:2ff:feb0:7fe4  prefixlen 64  scopeid 0x20<link>
        ether 00:9c:02:b0:7f:e4  txqueuelen 0  (Ethernet)
        RX packets 1  bytes 42 (42.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 8  bytes 648 (648.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

int-br-eth3: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet6 fe80::c404:41ff:fe33:acb0  prefixlen 64  scopeid 0x20<link>
        ether c6:04:41:33:ac:b0  txqueuelen 1000  (Ethernet)
        RX packets 8  bytes 648 (648.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 407  bytes 39690 (38.7 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

int-br-ex: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet6 fe80::3465:f7ff:fece:5c1f  prefixlen 64  scopeid 0x20<link>
        ether 36:65:f7:ce:5c:1f  txqueuelen 1000  (Ethernet)
        RX packets 656  bytes 47038 (45.9 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 407  bytes 39690 (38.7 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 0  (Local Loopback)
        RX packets 1393840  bytes 385979248 (368.0 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 1393840  bytes 385979248 (368.0 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

phy-br-eth3: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet6 fe80::6898:2bff:febb:7835  prefixlen 64  scopeid 0x20<link>
        ether 6a:98:2b:bb:78:35  txqueuelen 1000  (Ethernet)
        RX packets 407  bytes 39690 (38.7 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 8  bytes 648 (648.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

phy-br-ex: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet6 fe80::208d:caff:fe6a:1ddc  prefixlen 64  scopeid 0x20<link>
        ether 22:8d:ca:6a:1d:dc  txqueuelen 1000  (Ethernet)
        RX packets 407  bytes 39690 (38.7 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 656  bytes 47038 (45.9 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

Comment 15 Ofer Blaut 2014-07-08 11:57:12 UTC
bug https://bugzilla.redhat.com/show_bug.cgi?id=1117252

Comment 16 errata-xmlrpc 2014-07-08 15:39:53 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

http://rhn.redhat.com/errata/RHEA-2014-0846.html