Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 933685 Details for
Bug 1136309
Creation of VPN- IPsec Site Connection failed due to lock file - /var/lib/neutron/ipsec/... already exists
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
vpn-agent.log
vpn-agent.log (text/plain), 194.01 KB, created by
Toni Freger
on 2014-09-02 10:14:35 UTC
(
hide
)
Description:
vpn-agent.log
Filename:
MIME Type:
Creator:
Toni Freger
Created:
2014-09-02 10:14:35 UTC
Size:
194.01 KB
patch
obsolete
>2014-08-28 14:45:05.823 10332 INFO neutron.common.config [-] Logging enabled! >2014-08-28 14:45:05.909 10332 INFO neutron.openstack.common.rpc.common [req-15ff7978-9b89-498b-ae3f-6716cd7f24db None] Connected to AMQP server on 10.35.99.11:5672 >2014-08-28 14:45:05.910 10332 INFO neutron.openstack.common.rpc.common [req-5d4dfce1-5d76-4e84-a73b-bd3193798638 None] Connected to AMQP server on 10.35.99.11:5672 >2014-08-28 14:45:05.953 10332 INFO neutron.openstack.common.rpc.common [req-5d4dfce1-5d76-4e84-a73b-bd3193798638 None] Connected to AMQP server on 10.35.99.11:5672 >2014-08-28 14:45:05.954 10332 INFO neutron.openstack.common.rpc.common [req-5d4dfce1-5d76-4e84-a73b-bd3193798638 None] Connected to AMQP server on 10.35.99.11:5672 >2014-08-28 14:45:05.957 10332 INFO neutron.agent.l3_agent [req-5d4dfce1-5d76-4e84-a73b-bd3193798638 None] L3 agent started >2014-08-28 14:45:13.305 10332 INFO neutron.openstack.common.service [req-5d4dfce1-5d76-4e84-a73b-bd3193798638 None] Caught SIGTERM, exiting >2014-08-28 14:45:13.743 14949 INFO neutron.common.config [-] Logging enabled! >2014-08-28 14:45:13.834 14949 INFO neutron.openstack.common.rpc.common [req-42fc20b3-86b5-4948-8cf2-812b28898afe None] Connected to AMQP server on 10.35.99.11:5672 >2014-08-28 14:45:13.835 14949 INFO neutron.openstack.common.rpc.common [req-f5d05af8-00fc-496c-afda-5c5660599517 None] Connected to AMQP server on 10.35.99.11:5672 >2014-08-28 14:45:13.881 14949 INFO neutron.openstack.common.rpc.common [req-f5d05af8-00fc-496c-afda-5c5660599517 None] Connected to AMQP server on 10.35.99.11:5672 >2014-08-28 14:45:13.882 14949 INFO neutron.openstack.common.rpc.common [req-f5d05af8-00fc-496c-afda-5c5660599517 None] Connected to AMQP server on 10.35.99.11:5672 >2014-08-28 14:45:13.885 14949 INFO neutron.agent.l3_agent [req-f5d05af8-00fc-496c-afda-5c5660599517 None] L3 agent started >2014-08-28 15:23:46.683 14949 WARNING neutron.openstack.common.loopingcall [-] task run outlasted interval by 0.324795 sec >2014-08-28 15:43:45.026 14949 ERROR neutron.agent.l3_agent [-] The external network bridge 'br-ex' does not exist >2014-08-31 08:16:17.019 14949 INFO neutron.openstack.common.service [-] Caught SIGTERM, exiting >2014-08-31 08:23:43.934 8219 INFO neutron.common.config [-] Logging enabled! >2014-08-31 08:23:45.776 8219 INFO neutron.openstack.common.rpc.common [req-25936d07-9a91-4d01-b9c4-749feef9fab6 None] Connected to AMQP server on 10.35.99.11:5672 >2014-08-31 08:23:45.805 8219 INFO neutron.openstack.common.rpc.common [req-25936d07-9a91-4d01-b9c4-749feef9fab6 None] Connected to AMQP server on 10.35.99.11:5672 >2014-08-31 08:23:45.859 8219 INFO neutron.openstack.common.rpc.common [req-6745dd3e-0e12-4548-a927-98867a49bb47 None] Connected to AMQP server on 10.35.99.11:5672 >2014-08-31 08:23:45.862 8219 INFO neutron.openstack.common.rpc.common [req-6745dd3e-0e12-4548-a927-98867a49bb47 None] Connected to AMQP server on 10.35.99.11:5672 >2014-08-31 08:23:45.865 8219 INFO neutron.agent.l3_agent [req-6745dd3e-0e12-4548-a927-98867a49bb47 None] L3 agent started >2014-08-31 08:24:46.149 8219 ERROR neutron.agent.l3_agent [req-6745dd3e-0e12-4548-a927-98867a49bb47 None] Failed reporting state! >2014-08-31 08:24:46.149 8219 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-08-31 08:24:46.149 8219 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 957, in _report_state >2014-08-31 08:24:46.149 8219 TRACE neutron.agent.l3_agent self.use_call) >2014-08-31 08:24:46.149 8219 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/rpc.py", line 72, in report_state >2014-08-31 08:24:46.149 8219 TRACE neutron.agent.l3_agent return self.call(context, msg, topic=self.topic) >2014-08-31 08:24:46.149 8219 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/openstack/common/rpc/proxy.py", line 129, in call >2014-08-31 08:24:46.149 8219 TRACE neutron.agent.l3_agent exc.info, real_topic, msg.get('method')) >2014-08-31 08:24:46.149 8219 TRACE neutron.agent.l3_agent Timeout: Timeout while waiting on RPC response - topic: "q-plugin", RPC method: "report_state" info: "<unknown>" >2014-08-31 08:24:46.149 8219 TRACE neutron.agent.l3_agent >2014-08-31 08:24:46.150 8219 WARNING neutron.openstack.common.loopingcall [req-6745dd3e-0e12-4548-a927-98867a49bb47 None] task run outlasted interval by 30.385434 sec >2014-08-31 08:24:46.150 8219 ERROR neutron.agent.l3_agent [req-6745dd3e-0e12-4548-a927-98867a49bb47 None] Failed synchronizing routers due to RPC error >2014-08-31 08:24:46.150 8219 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-08-31 08:24:46.150 8219 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 861, in _sync_routers_task >2014-08-31 08:24:46.150 8219 TRACE neutron.agent.l3_agent context, router_ids) >2014-08-31 08:24:46.150 8219 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 75, in get_routers >2014-08-31 08:24:46.150 8219 TRACE neutron.agent.l3_agent topic=self.topic) >2014-08-31 08:24:46.150 8219 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/openstack/common/rpc/proxy.py", line 129, in call >2014-08-31 08:24:46.150 8219 TRACE neutron.agent.l3_agent exc.info, real_topic, msg.get('method')) >2014-08-31 08:24:46.150 8219 TRACE neutron.agent.l3_agent Timeout: Timeout while waiting on RPC response - topic: "q-l3-plugin", RPC method: "sync_routers" info: "<unknown>" >2014-08-31 08:24:46.150 8219 TRACE neutron.agent.l3_agent >2014-08-31 08:24:46.152 8219 WARNING neutron.openstack.common.loopingcall [req-6745dd3e-0e12-4548-a927-98867a49bb47 None] task run outlasted interval by 58.387618 sec >2014-08-31 08:24:46.152 8219 WARNING neutron.openstack.common.loopingcall [req-6745dd3e-0e12-4548-a927-98867a49bb47 None] task run outlasted interval by 20.28636 sec >2014-08-31 08:24:46.160 8219 INFO neutron.openstack.common.rpc.common [req-6745dd3e-0e12-4548-a927-98867a49bb47 None] Connected to AMQP server on 10.35.99.11:5672 >2014-08-31 08:24:48.951 8219 WARNING neutron.openstack.common.loopingcall [-] task run outlasted interval by 0.798448 sec >2014-08-31 11:49:22.064 8219 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-08-31 11:49:22.064 8219 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-08-31 11:49:22.064 8219 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 831, in _rpc_loop >2014-08-31 11:49:22.064 8219 TRACE neutron.agent.l3_agent self._process_router_delete() >2014-08-31 11:49:22.064 8219 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 840, in _process_router_delete >2014-08-31 11:49:22.064 8219 TRACE neutron.agent.l3_agent self._router_removed(router_id) >2014-08-31 11:49:22.064 8219 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 131, in _router_removed >2014-08-31 11:49:22.064 8219 TRACE neutron.agent.l3_agent super(VPNAgent, self)._router_removed(router_id) >2014-08-31 11:49:22.064 8219 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 370, in _router_removed >2014-08-31 11:49:22.064 8219 TRACE neutron.agent.l3_agent self._destroy_metadata_proxy(ri.router_id, ri.ns_name) >2014-08-31 11:49:22.064 8219 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 401, in _destroy_metadata_proxy >2014-08-31 11:49:22.064 8219 TRACE neutron.agent.l3_agent pm.disable() >2014-08-31 11:49:22.064 8219 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/linux/external_process.py", line 61, in disable >2014-08-31 11:49:22.064 8219 TRACE neutron.agent.l3_agent utils.execute(cmd, self.root_helper) >2014-08-31 11:49:22.064 8219 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-08-31 11:49:22.064 8219 TRACE neutron.agent.l3_agent raise RuntimeError(m) >2014-08-31 11:49:22.064 8219 TRACE neutron.agent.l3_agent RuntimeError: >2014-08-31 11:49:22.064 8219 TRACE neutron.agent.l3_agent Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'kill', '-9', '10910'] >2014-08-31 11:49:22.064 8219 TRACE neutron.agent.l3_agent Exit code: 99 >2014-08-31 11:49:22.064 8219 TRACE neutron.agent.l3_agent Stdout: '' >2014-08-31 11:49:22.064 8219 TRACE neutron.agent.l3_agent Stderr: '/usr/bin/neutron-rootwrap: Unauthorized command: kill -9 10910 (no filter matched)\n' >2014-08-31 11:49:22.064 8219 TRACE neutron.agent.l3_agent >2014-08-31 11:49:23.028 8219 WARNING neutron.agent.linux.iptables_manager [-] Tried to remove rule that was not there: 'INPUT' '-s 0.0.0.0/0 -d 127.0.0.1 -p tcp -m tcp --dport 9697 -j ACCEPT' True False >2014-08-31 11:49:23.029 8219 WARNING neutron.agent.linux.iptables_manager [-] Tried to remove rule that was not there: 'PREROUTING' '-s 0.0.0.0/0 -d 169.254.169.254/32 -p tcp -m tcp --dport 80 -j REDIRECT --to-port 9697' True False >2014-08-31 11:49:51.066 8219 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-08-31 11:49:51.066 8219 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-08-31 11:49:51.066 8219 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 831, in _rpc_loop >2014-08-31 11:49:51.066 8219 TRACE neutron.agent.l3_agent self._process_router_delete() >2014-08-31 11:49:51.066 8219 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 840, in _process_router_delete >2014-08-31 11:49:51.066 8219 TRACE neutron.agent.l3_agent self._router_removed(router_id) >2014-08-31 11:49:51.066 8219 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 131, in _router_removed >2014-08-31 11:49:51.066 8219 TRACE neutron.agent.l3_agent super(VPNAgent, self)._router_removed(router_id) >2014-08-31 11:49:51.066 8219 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 370, in _router_removed >2014-08-31 11:49:51.066 8219 TRACE neutron.agent.l3_agent self._destroy_metadata_proxy(ri.router_id, ri.ns_name) >2014-08-31 11:49:51.066 8219 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 401, in _destroy_metadata_proxy >2014-08-31 11:49:51.066 8219 TRACE neutron.agent.l3_agent pm.disable() >2014-08-31 11:49:51.066 8219 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/linux/external_process.py", line 61, in disable >2014-08-31 11:49:51.066 8219 TRACE neutron.agent.l3_agent utils.execute(cmd, self.root_helper) >2014-08-31 11:49:51.066 8219 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-08-31 11:49:51.066 8219 TRACE neutron.agent.l3_agent raise RuntimeError(m) >2014-08-31 11:49:51.066 8219 TRACE neutron.agent.l3_agent RuntimeError: >2014-08-31 11:49:51.066 8219 TRACE neutron.agent.l3_agent Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'kill', '-9', '10674'] >2014-08-31 11:49:51.066 8219 TRACE neutron.agent.l3_agent Exit code: 99 >2014-08-31 11:49:51.066 8219 TRACE neutron.agent.l3_agent Stdout: '' >2014-08-31 11:49:51.066 8219 TRACE neutron.agent.l3_agent Stderr: '/usr/bin/neutron-rootwrap: Unauthorized command: kill -9 10674 (no filter matched)\n' >2014-08-31 11:49:51.066 8219 TRACE neutron.agent.l3_agent >2014-08-31 11:49:52.032 8219 WARNING neutron.agent.linux.iptables_manager [-] Tried to remove rule that was not there: 'INPUT' '-s 0.0.0.0/0 -d 127.0.0.1 -p tcp -m tcp --dport 9697 -j ACCEPT' True False >2014-08-31 11:49:52.032 8219 WARNING neutron.agent.linux.iptables_manager [-] Tried to remove rule that was not there: 'PREROUTING' '-s 0.0.0.0/0 -d 169.254.169.254/32 -p tcp -m tcp --dport 80 -j REDIRECT --to-port 9697' True False >2014-08-31 11:51:28.729 8219 INFO neutron.agent.linux.interface [-] Device qg-e7570787-cd already exists >2014-08-31 11:51:29.030 8219 WARNING neutron.openstack.common.loopingcall [-] task run outlasted interval by 0.018343 sec >2014-08-31 14:46:55.808 8219 ERROR neutron.services.vpn.device_drivers.ipsec [req-65d2c82a-e2dd-43d6-8da8-c89666a6d513 None] Failed to enable vpn process on router 4b36295c-68a5-4281-9c94-503475f067ac >2014-08-31 14:46:55.808 8219 TRACE neutron.services.vpn.device_drivers.ipsec Traceback (most recent call last): >2014-08-31 14:46:55.808 8219 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 245, in enable >2014-08-31 14:46:55.808 8219 TRACE neutron.services.vpn.device_drivers.ipsec self.restart() >2014-08-31 14:46:55.808 8219 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 345, in restart >2014-08-31 14:46:55.808 8219 TRACE neutron.services.vpn.device_drivers.ipsec self.start() >2014-08-31 14:46:55.808 8219 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 388, in start >2014-08-31 14:46:55.808 8219 TRACE neutron.services.vpn.device_drivers.ipsec '--virtual_private', virtual_private >2014-08-31 14:46:55.808 8219 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 317, in _execute >2014-08-31 14:46:55.808 8219 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-08-31 14:46:55.808 8219 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 467, in execute >2014-08-31 14:46:55.808 8219 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-08-31 14:46:55.808 8219 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-08-31 14:46:55.808 8219 TRACE neutron.services.vpn.device_drivers.ipsec raise RuntimeError(m) >2014-08-31 14:46:55.808 8219 TRACE neutron.services.vpn.device_drivers.ipsec RuntimeError: >2014-08-31 14:46:55.808 8219 TRACE neutron.services.vpn.device_drivers.ipsec Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-4b36295c-68a5-4281-9c94-503475f067ac', 'ipsec', 'pluto', '--ctlbase', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto', '--ipsecdir', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc', '--use-netkey', '--uniqueids', '--nat_traversal', '--secretsfile', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc/ipsec.secrets', '--virtual_private', '%v4:10.10.10.0/24,%v4:20.20.20/24'] >2014-08-31 14:46:55.808 8219 TRACE neutron.services.vpn.device_drivers.ipsec Exit code: 10 >2014-08-31 14:46:55.808 8219 TRACE neutron.services.vpn.device_drivers.ipsec Stdout: '' >2014-08-31 14:46:55.808 8219 TRACE neutron.services.vpn.device_drivers.ipsec Stderr: 'adjusting ipsec.d to /var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc\npluto: lock file "/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto.pid" already exists\n' >2014-08-31 14:46:55.808 8219 TRACE neutron.services.vpn.device_drivers.ipsec >2014-08-31 15:16:08.466 8219 ERROR neutron.services.vpn.device_drivers.ipsec [req-d27fb0d9-fe27-4061-8616-b7df5849caeb None] Failed to enable vpn process on router 4b36295c-68a5-4281-9c94-503475f067ac >2014-08-31 15:16:08.466 8219 TRACE neutron.services.vpn.device_drivers.ipsec Traceback (most recent call last): >2014-08-31 15:16:08.466 8219 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 247, in enable >2014-08-31 15:16:08.466 8219 TRACE neutron.services.vpn.device_drivers.ipsec self.start() >2014-08-31 15:16:08.466 8219 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 388, in start >2014-08-31 15:16:08.466 8219 TRACE neutron.services.vpn.device_drivers.ipsec '--virtual_private', virtual_private >2014-08-31 15:16:08.466 8219 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 317, in _execute >2014-08-31 15:16:08.466 8219 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-08-31 15:16:08.466 8219 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 467, in execute >2014-08-31 15:16:08.466 8219 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-08-31 15:16:08.466 8219 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-08-31 15:16:08.466 8219 TRACE neutron.services.vpn.device_drivers.ipsec raise RuntimeError(m) >2014-08-31 15:16:08.466 8219 TRACE neutron.services.vpn.device_drivers.ipsec RuntimeError: >2014-08-31 15:16:08.466 8219 TRACE neutron.services.vpn.device_drivers.ipsec Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-4b36295c-68a5-4281-9c94-503475f067ac', 'ipsec', 'pluto', '--ctlbase', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto', '--ipsecdir', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc', '--use-netkey', '--uniqueids', '--nat_traversal', '--secretsfile', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc/ipsec.secrets', '--virtual_private', '%v4:10.10.10.0/24,%v4:20.20.20/24'] >2014-08-31 15:16:08.466 8219 TRACE neutron.services.vpn.device_drivers.ipsec Exit code: 10 >2014-08-31 15:16:08.466 8219 TRACE neutron.services.vpn.device_drivers.ipsec Stdout: '' >2014-08-31 15:16:08.466 8219 TRACE neutron.services.vpn.device_drivers.ipsec Stderr: 'adjusting ipsec.d to /var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc\npluto: lock file "/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto.pid" already exists\n' >2014-08-31 15:16:08.466 8219 TRACE neutron.services.vpn.device_drivers.ipsec >2014-08-31 15:16:08.681 8219 WARNING neutron.agent.linux.iptables_manager [req-d27fb0d9-fe27-4061-8616-b7df5849caeb None] Tried to remove rule that was not there: 'POSTROUTING' u'-s 20.20.20.0/24 -d 10.10.10.0/24 -m policy --dir out --pol ipsec -j ACCEPT ' True False >2014-08-31 15:16:17.715 8219 WARNING neutron.agent.linux.iptables_manager [req-3ed05c82-f28e-48e7-af2d-fabc65d82737 None] Tried to remove rule that was not there: 'POSTROUTING' u'-s 10.10.10.0/24 -d 20.20.20/24 -m policy --dir out --pol ipsec -j ACCEPT ' True False >2014-08-31 15:39:07.060 8219 INFO neutron.openstack.common.service [-] Caught SIGTERM, exiting >2014-08-31 15:39:07.460 13395 INFO neutron.common.config [-] Logging enabled! >2014-08-31 15:39:07.533 13395 INFO neutron.openstack.common.rpc.common [req-0338a677-2b49-4e1a-b4c0-c16d32476ba1 None] Connected to AMQP server on 10.35.99.11:5672 >2014-08-31 15:39:07.533 13395 INFO neutron.openstack.common.rpc.common [req-1476f3da-2f99-4fb4-b021-a17b60a90ae9 None] Connected to AMQP server on 10.35.99.11:5672 >2014-08-31 15:39:07.572 13395 INFO neutron.openstack.common.rpc.common [req-1476f3da-2f99-4fb4-b021-a17b60a90ae9 None] Connected to AMQP server on 10.35.99.11:5672 >2014-08-31 15:39:07.573 13395 INFO neutron.openstack.common.rpc.common [req-1476f3da-2f99-4fb4-b021-a17b60a90ae9 None] Connected to AMQP server on 10.35.99.11:5672 >2014-08-31 15:39:07.577 13395 INFO neutron.agent.l3_agent [req-1476f3da-2f99-4fb4-b021-a17b60a90ae9 None] L3 agent started >2014-08-31 15:39:13.018 13395 INFO neutron.agent.linux.interface [-] Device qg-e7570787-cd already exists >2014-08-31 15:39:13.222 13395 INFO neutron.agent.linux.interface [-] Device qg-6cf96a99-2f already exists >2014-08-31 15:41:16.466 13395 ERROR neutron.services.vpn.device_drivers.ipsec [req-c13f0bac-215c-42fc-a8ad-5b34151b9298 None] Failed to enable vpn process on router 4b36295c-68a5-4281-9c94-503475f067ac >2014-08-31 15:41:16.466 13395 TRACE neutron.services.vpn.device_drivers.ipsec Traceback (most recent call last): >2014-08-31 15:41:16.466 13395 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 245, in enable >2014-08-31 15:41:16.466 13395 TRACE neutron.services.vpn.device_drivers.ipsec self.restart() >2014-08-31 15:41:16.466 13395 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 345, in restart >2014-08-31 15:41:16.466 13395 TRACE neutron.services.vpn.device_drivers.ipsec self.start() >2014-08-31 15:41:16.466 13395 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 388, in start >2014-08-31 15:41:16.466 13395 TRACE neutron.services.vpn.device_drivers.ipsec '--virtual_private', virtual_private >2014-08-31 15:41:16.466 13395 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 317, in _execute >2014-08-31 15:41:16.466 13395 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-08-31 15:41:16.466 13395 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 467, in execute >2014-08-31 15:41:16.466 13395 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-08-31 15:41:16.466 13395 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-08-31 15:41:16.466 13395 TRACE neutron.services.vpn.device_drivers.ipsec raise RuntimeError(m) >2014-08-31 15:41:16.466 13395 TRACE neutron.services.vpn.device_drivers.ipsec RuntimeError: >2014-08-31 15:41:16.466 13395 TRACE neutron.services.vpn.device_drivers.ipsec Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-4b36295c-68a5-4281-9c94-503475f067ac', 'ipsec', 'pluto', '--ctlbase', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto', '--ipsecdir', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc', '--use-netkey', '--uniqueids', '--nat_traversal', '--secretsfile', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc/ipsec.secrets', '--virtual_private', '%v4:10.10.10.0/24,%v4:20.20.20/24'] >2014-08-31 15:41:16.466 13395 TRACE neutron.services.vpn.device_drivers.ipsec Exit code: 10 >2014-08-31 15:41:16.466 13395 TRACE neutron.services.vpn.device_drivers.ipsec Stdout: '' >2014-08-31 15:41:16.466 13395 TRACE neutron.services.vpn.device_drivers.ipsec Stderr: 'adjusting ipsec.d to /var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc\npluto: lock file "/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto.pid" already exists\n' >2014-08-31 15:41:16.466 13395 TRACE neutron.services.vpn.device_drivers.ipsec >2014-08-31 15:43:48.497 13395 WARNING neutron.agent.linux.iptables_manager [req-d9eefbd1-b9b5-4e2b-a9c5-1da32f9b80df None] Tried to remove rule that was not there: 'POSTROUTING' u'-s 20.20.20.0/24 -d 10.10.10.0/24 -m policy --dir out --pol ipsec -j ACCEPT ' True False >2014-08-31 15:44:04.737 13395 WARNING neutron.agent.linux.iptables_manager [req-b7c2cb77-286a-47d0-a347-a2bbde07b8c4 None] Tried to remove rule that was not there: 'POSTROUTING' u'-s 10.10.10.0/24 -d 20.20.20/24 -m policy --dir out --pol ipsec -j ACCEPT ' True False >2014-08-31 15:45:34.562 13395 ERROR neutron.services.vpn.device_drivers.ipsec [req-443f4d6b-e710-4dd4-ba12-7ab4206177b8 None] Failed to enable vpn process on router 4b36295c-68a5-4281-9c94-503475f067ac >2014-08-31 15:45:34.562 13395 TRACE neutron.services.vpn.device_drivers.ipsec Traceback (most recent call last): >2014-08-31 15:45:34.562 13395 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 245, in enable >2014-08-31 15:45:34.562 13395 TRACE neutron.services.vpn.device_drivers.ipsec self.restart() >2014-08-31 15:45:34.562 13395 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 345, in restart >2014-08-31 15:45:34.562 13395 TRACE neutron.services.vpn.device_drivers.ipsec self.start() >2014-08-31 15:45:34.562 13395 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 388, in start >2014-08-31 15:45:34.562 13395 TRACE neutron.services.vpn.device_drivers.ipsec '--virtual_private', virtual_private >2014-08-31 15:45:34.562 13395 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 317, in _execute >2014-08-31 15:45:34.562 13395 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-08-31 15:45:34.562 13395 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 467, in execute >2014-08-31 15:45:34.562 13395 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-08-31 15:45:34.562 13395 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-08-31 15:45:34.562 13395 TRACE neutron.services.vpn.device_drivers.ipsec raise RuntimeError(m) >2014-08-31 15:45:34.562 13395 TRACE neutron.services.vpn.device_drivers.ipsec RuntimeError: >2014-08-31 15:45:34.562 13395 TRACE neutron.services.vpn.device_drivers.ipsec Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-4b36295c-68a5-4281-9c94-503475f067ac', 'ipsec', 'pluto', '--ctlbase', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto', '--ipsecdir', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc', '--use-netkey', '--uniqueids', '--nat_traversal', '--secretsfile', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc/ipsec.secrets', '--virtual_private', '%v4:10.10.10.0/24,%v4:20.20.20.0/24'] >2014-08-31 15:45:34.562 13395 TRACE neutron.services.vpn.device_drivers.ipsec Exit code: 10 >2014-08-31 15:45:34.562 13395 TRACE neutron.services.vpn.device_drivers.ipsec Stdout: '' >2014-08-31 15:45:34.562 13395 TRACE neutron.services.vpn.device_drivers.ipsec Stderr: 'adjusting ipsec.d to /var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc\npluto: lock file "/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto.pid" already exists\n' >2014-08-31 15:45:34.562 13395 TRACE neutron.services.vpn.device_drivers.ipsec >2014-08-31 15:59:08.909 13395 INFO neutron.openstack.common.service [-] Caught SIGTERM, exiting >2014-08-31 15:59:09.378 19027 INFO neutron.common.config [-] Logging enabled! >2014-08-31 15:59:09.487 19027 INFO neutron.openstack.common.rpc.common [req-d8069326-0cfc-4a5c-9e41-c5a7448e507f None] Connected to AMQP server on 10.35.99.11:5672 >2014-08-31 15:59:09.488 19027 INFO neutron.openstack.common.rpc.common [req-441c927b-f23d-4a33-9291-ac8de6162951 None] Connected to AMQP server on 10.35.99.11:5672 >2014-08-31 15:59:09.545 19027 INFO neutron.openstack.common.rpc.common [req-441c927b-f23d-4a33-9291-ac8de6162951 None] Connected to AMQP server on 10.35.99.11:5672 >2014-08-31 15:59:09.546 19027 INFO neutron.openstack.common.rpc.common [req-441c927b-f23d-4a33-9291-ac8de6162951 None] Connected to AMQP server on 10.35.99.11:5672 >2014-08-31 15:59:09.551 19027 INFO neutron.agent.l3_agent [req-441c927b-f23d-4a33-9291-ac8de6162951 None] L3 agent started >2014-08-31 15:59:10.522 19027 INFO neutron.agent.linux.interface [-] Device qg-e7570787-cd already exists >2014-08-31 15:59:10.701 19027 INFO neutron.agent.linux.interface [-] Device qg-6cf96a99-2f already exists >2014-08-31 15:59:11.958 19027 ERROR neutron.services.vpn.device_drivers.ipsec [-] Failed to enable vpn process on router 4b36295c-68a5-4281-9c94-503475f067ac >2014-08-31 15:59:11.958 19027 TRACE neutron.services.vpn.device_drivers.ipsec Traceback (most recent call last): >2014-08-31 15:59:11.958 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 247, in enable >2014-08-31 15:59:11.958 19027 TRACE neutron.services.vpn.device_drivers.ipsec self.start() >2014-08-31 15:59:11.958 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 388, in start >2014-08-31 15:59:11.958 19027 TRACE neutron.services.vpn.device_drivers.ipsec '--virtual_private', virtual_private >2014-08-31 15:59:11.958 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 317, in _execute >2014-08-31 15:59:11.958 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-08-31 15:59:11.958 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 467, in execute >2014-08-31 15:59:11.958 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-08-31 15:59:11.958 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-08-31 15:59:11.958 19027 TRACE neutron.services.vpn.device_drivers.ipsec raise RuntimeError(m) >2014-08-31 15:59:11.958 19027 TRACE neutron.services.vpn.device_drivers.ipsec RuntimeError: >2014-08-31 15:59:11.958 19027 TRACE neutron.services.vpn.device_drivers.ipsec Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-4b36295c-68a5-4281-9c94-503475f067ac', 'ipsec', 'pluto', '--ctlbase', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto', '--ipsecdir', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc', '--use-netkey', '--uniqueids', '--nat_traversal', '--secretsfile', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc/ipsec.secrets', '--virtual_private', '%v4:10.10.10.0/24,%v4:20.20.20.0/24'] >2014-08-31 15:59:11.958 19027 TRACE neutron.services.vpn.device_drivers.ipsec Exit code: 10 >2014-08-31 15:59:11.958 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stdout: '' >2014-08-31 15:59:11.958 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stderr: 'adjusting ipsec.d to /var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc\npluto: lock file "/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto.pid" already exists\n' >2014-08-31 15:59:11.958 19027 TRACE neutron.services.vpn.device_drivers.ipsec >2014-08-31 15:59:12.346 19027 WARNING neutron.openstack.common.loopingcall [-] task run outlasted interval by 0.867464 sec >2014-09-01 10:19:59.865 19027 ERROR neutron.services.vpn.device_drivers.ipsec [req-9fcac98f-4ff5-4795-8adb-2909c0dec905 None] Failed to enable vpn process on router 4b36295c-68a5-4281-9c94-503475f067ac >2014-09-01 10:19:59.865 19027 TRACE neutron.services.vpn.device_drivers.ipsec Traceback (most recent call last): >2014-09-01 10:19:59.865 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 247, in enable >2014-09-01 10:19:59.865 19027 TRACE neutron.services.vpn.device_drivers.ipsec self.start() >2014-09-01 10:19:59.865 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 388, in start >2014-09-01 10:19:59.865 19027 TRACE neutron.services.vpn.device_drivers.ipsec '--virtual_private', virtual_private >2014-09-01 10:19:59.865 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 317, in _execute >2014-09-01 10:19:59.865 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-01 10:19:59.865 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 467, in execute >2014-09-01 10:19:59.865 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-01 10:19:59.865 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-09-01 10:19:59.865 19027 TRACE neutron.services.vpn.device_drivers.ipsec raise RuntimeError(m) >2014-09-01 10:19:59.865 19027 TRACE neutron.services.vpn.device_drivers.ipsec RuntimeError: >2014-09-01 10:19:59.865 19027 TRACE neutron.services.vpn.device_drivers.ipsec Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-4b36295c-68a5-4281-9c94-503475f067ac', 'ipsec', 'pluto', '--ctlbase', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto', '--ipsecdir', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc', '--use-netkey', '--uniqueids', '--nat_traversal', '--secretsfile', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc/ipsec.secrets', '--virtual_private', '%v4:10.10.10.0/24,%v4:20.20.20.0/24'] >2014-09-01 10:19:59.865 19027 TRACE neutron.services.vpn.device_drivers.ipsec Exit code: 10 >2014-09-01 10:19:59.865 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stdout: '' >2014-09-01 10:19:59.865 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stderr: 'adjusting ipsec.d to /var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc\npluto: lock file "/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto.pid" already exists\n' >2014-09-01 10:19:59.865 19027 TRACE neutron.services.vpn.device_drivers.ipsec >2014-09-01 10:20:00.064 19027 WARNING neutron.agent.linux.iptables_manager [req-9fcac98f-4ff5-4795-8adb-2909c0dec905 None] Tried to remove rule that was not there: 'POSTROUTING' u'-s 20.20.20.0/24 -d 10.10.10.0/24 -m policy --dir out --pol ipsec -j ACCEPT ' True False >2014-09-01 10:20:06.576 19027 WARNING neutron.agent.linux.iptables_manager [req-817ce1c3-211e-499e-bc2e-903924fba7ef None] Tried to remove rule that was not there: 'POSTROUTING' u'-s 10.10.10.0/24 -d 20.20.20.0/24 -m policy --dir out --pol ipsec -j ACCEPT ' True False >2014-09-02 08:24:06.243 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 08:24:06.243 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 08:24:06.243 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 830, in _rpc_loop >2014-09-02 08:24:06.243 19027 TRACE neutron.agent.l3_agent self._process_routers(routers) >2014-09-02 08:24:06.243 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 08:24:06.243 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 08:24:06.243 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 08:24:06.243 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 08:24:06.243 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 08:24:06.243 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 08:24:06.243 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 08:24:06.243 19027 TRACE neutron.agent.l3_agent >2014-09-02 08:24:30.212 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 08:24:30.212 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 08:24:30.212 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 08:24:30.212 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 08:24:30.212 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 08:24:30.212 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 08:24:30.212 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 08:24:30.212 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 08:24:30.212 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 08:24:30.212 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 08:24:30.212 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 08:24:30.212 19027 TRACE neutron.agent.l3_agent >2014-09-02 08:25:10.205 19027 INFO neutron.openstack.common.rpc.common [-] Connected to AMQP server on 10.35.99.11:5672 >2014-09-02 08:25:10.220 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 08:25:10.220 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 08:25:10.220 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 08:25:10.220 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 08:25:10.220 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 08:25:10.220 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 08:25:10.220 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 08:25:10.220 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 08:25:10.220 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 08:25:10.220 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 08:25:10.220 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 08:25:10.220 19027 TRACE neutron.agent.l3_agent >2014-09-02 08:25:50.213 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 08:25:50.213 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 08:25:50.213 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 08:25:50.213 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 08:25:50.213 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 08:25:50.213 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 08:25:50.213 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 08:25:50.213 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 08:25:50.213 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 08:25:50.213 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 08:25:50.213 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 08:25:50.213 19027 TRACE neutron.agent.l3_agent >2014-09-02 08:26:30.210 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 08:26:30.210 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 08:26:30.210 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 08:26:30.210 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 08:26:30.210 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 08:26:30.210 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 08:26:30.210 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 08:26:30.210 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 08:26:30.210 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 08:26:30.210 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 08:26:30.210 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 08:26:30.210 19027 TRACE neutron.agent.l3_agent >2014-09-02 08:27:10.232 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 08:27:10.232 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 08:27:10.232 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 08:27:10.232 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 08:27:10.232 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 08:27:10.232 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 08:27:10.232 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 08:27:10.232 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 08:27:10.232 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 08:27:10.232 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 08:27:10.232 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 08:27:10.232 19027 TRACE neutron.agent.l3_agent >2014-09-02 08:50:48.564 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 08:50:48.564 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 08:50:48.564 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 830, in _rpc_loop >2014-09-02 08:50:48.564 19027 TRACE neutron.agent.l3_agent self._process_routers(routers) >2014-09-02 08:50:48.564 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 08:50:48.564 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 08:50:48.564 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 08:50:48.564 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 08:50:48.564 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 08:50:48.564 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 08:50:48.564 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 08:50:48.564 19027 TRACE neutron.agent.l3_agent >2014-09-02 08:51:10.222 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 08:51:10.222 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 08:51:10.222 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 08:51:10.222 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 08:51:10.222 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 08:51:10.222 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 08:51:10.222 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 08:51:10.222 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 08:51:10.222 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 08:51:10.222 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 08:51:10.222 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 08:51:10.222 19027 TRACE neutron.agent.l3_agent >2014-09-02 08:51:50.222 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 08:51:50.222 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 08:51:50.222 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 08:51:50.222 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 08:51:50.222 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 08:51:50.222 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 08:51:50.222 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 08:51:50.222 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 08:51:50.222 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 08:51:50.222 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 08:51:50.222 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 08:51:50.222 19027 TRACE neutron.agent.l3_agent >2014-09-02 08:52:30.225 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 08:52:30.225 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 08:52:30.225 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 08:52:30.225 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 08:52:30.225 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 08:52:30.225 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 08:52:30.225 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 08:52:30.225 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 08:52:30.225 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 08:52:30.225 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 08:52:30.225 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 08:52:30.225 19027 TRACE neutron.agent.l3_agent >2014-09-02 08:52:39.904 19027 ERROR neutron.services.vpn.device_drivers.ipsec [req-23232862-3a6f-4cb5-b9cd-332c7c8c6f8c None] Failed to enable vpn process on router 6fbb2b8d-fb48-46f5-a093-5b2653161523 >2014-09-02 08:52:39.904 19027 TRACE neutron.services.vpn.device_drivers.ipsec Traceback (most recent call last): >2014-09-02 08:52:39.904 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 247, in enable >2014-09-02 08:52:39.904 19027 TRACE neutron.services.vpn.device_drivers.ipsec self.start() >2014-09-02 08:52:39.904 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 392, in start >2014-09-02 08:52:39.904 19027 TRACE neutron.services.vpn.device_drivers.ipsec nexthop = self._get_nexthop(ipsec_site_conn['peer_address']) >2014-09-02 08:52:39.904 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 350, in _get_nexthop >2014-09-02 08:52:39.904 19027 TRACE neutron.services.vpn.device_drivers.ipsec ['ip', 'route', 'get', address]) >2014-09-02 08:52:39.904 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 317, in _execute >2014-09-02 08:52:39.904 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 08:52:39.904 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 467, in execute >2014-09-02 08:52:39.904 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 08:52:39.904 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-09-02 08:52:39.904 19027 TRACE neutron.services.vpn.device_drivers.ipsec raise RuntimeError(m) >2014-09-02 08:52:39.904 19027 TRACE neutron.services.vpn.device_drivers.ipsec RuntimeError: >2014-09-02 08:52:39.904 19027 TRACE neutron.services.vpn.device_drivers.ipsec Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-6fbb2b8d-fb48-46f5-a093-5b2653161523', 'ip', 'route', 'get', '192.168.1.5'] >2014-09-02 08:52:39.904 19027 TRACE neutron.services.vpn.device_drivers.ipsec Exit code: 2 >2014-09-02 08:52:39.904 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stdout: '' >2014-09-02 08:52:39.904 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stderr: 'RTNETLINK answers: Network is unreachable\n' >2014-09-02 08:52:39.904 19027 TRACE neutron.services.vpn.device_drivers.ipsec >2014-09-02 08:53:10.244 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 08:53:10.244 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 08:53:10.244 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 08:53:10.244 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 08:53:10.244 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 08:53:10.244 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 08:53:10.244 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 08:53:10.244 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 08:53:10.244 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 08:53:10.244 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 08:53:10.244 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 08:53:10.244 19027 TRACE neutron.agent.l3_agent >2014-09-02 08:53:47.256 19027 ERROR neutron.services.vpn.device_drivers.ipsec [req-b9e29bcb-24e4-4875-8fa9-d02e42de69d6 None] Failed to enable vpn process on router 6fbb2b8d-fb48-46f5-a093-5b2653161523 >2014-09-02 08:53:47.256 19027 TRACE neutron.services.vpn.device_drivers.ipsec Traceback (most recent call last): >2014-09-02 08:53:47.256 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 245, in enable >2014-09-02 08:53:47.256 19027 TRACE neutron.services.vpn.device_drivers.ipsec self.restart() >2014-09-02 08:53:47.256 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 345, in restart >2014-09-02 08:53:47.256 19027 TRACE neutron.services.vpn.device_drivers.ipsec self.start() >2014-09-02 08:53:47.256 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 388, in start >2014-09-02 08:53:47.256 19027 TRACE neutron.services.vpn.device_drivers.ipsec '--virtual_private', virtual_private >2014-09-02 08:53:47.256 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 317, in _execute >2014-09-02 08:53:47.256 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 08:53:47.256 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 467, in execute >2014-09-02 08:53:47.256 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 08:53:47.256 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-09-02 08:53:47.256 19027 TRACE neutron.services.vpn.device_drivers.ipsec raise RuntimeError(m) >2014-09-02 08:53:47.256 19027 TRACE neutron.services.vpn.device_drivers.ipsec RuntimeError: >2014-09-02 08:53:47.256 19027 TRACE neutron.services.vpn.device_drivers.ipsec Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-6fbb2b8d-fb48-46f5-a093-5b2653161523', 'ipsec', 'pluto', '--ctlbase', '/var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/var/run/pluto', '--ipsecdir', '/var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/etc', '--use-netkey', '--uniqueids', '--nat_traversal', '--secretsfile', '/var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/etc/ipsec.secrets', '--virtual_private', '%v4:20.20.20.0/24,%v4:10.10.10.0/24'] >2014-09-02 08:53:47.256 19027 TRACE neutron.services.vpn.device_drivers.ipsec Exit code: 10 >2014-09-02 08:53:47.256 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stdout: '' >2014-09-02 08:53:47.256 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stderr: 'adjusting ipsec.d to /var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/etc\npluto: lock file "/var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/var/run/pluto.pid" already exists\n' >2014-09-02 08:53:47.256 19027 TRACE neutron.services.vpn.device_drivers.ipsec >2014-09-02 08:53:47.455 19027 ERROR neutron.services.vpn.device_drivers.ipsec [req-b9e29bcb-24e4-4875-8fa9-d02e42de69d6 None] Failed to enable vpn process on router 4b36295c-68a5-4281-9c94-503475f067ac >2014-09-02 08:53:47.455 19027 TRACE neutron.services.vpn.device_drivers.ipsec Traceback (most recent call last): >2014-09-02 08:53:47.455 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 247, in enable >2014-09-02 08:53:47.455 19027 TRACE neutron.services.vpn.device_drivers.ipsec self.start() >2014-09-02 08:53:47.455 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 392, in start >2014-09-02 08:53:47.455 19027 TRACE neutron.services.vpn.device_drivers.ipsec nexthop = self._get_nexthop(ipsec_site_conn['peer_address']) >2014-09-02 08:53:47.455 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 350, in _get_nexthop >2014-09-02 08:53:47.455 19027 TRACE neutron.services.vpn.device_drivers.ipsec ['ip', 'route', 'get', address]) >2014-09-02 08:53:47.455 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 317, in _execute >2014-09-02 08:53:47.455 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 08:53:47.455 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 467, in execute >2014-09-02 08:53:47.455 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 08:53:47.455 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-09-02 08:53:47.455 19027 TRACE neutron.services.vpn.device_drivers.ipsec raise RuntimeError(m) >2014-09-02 08:53:47.455 19027 TRACE neutron.services.vpn.device_drivers.ipsec RuntimeError: >2014-09-02 08:53:47.455 19027 TRACE neutron.services.vpn.device_drivers.ipsec Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-4b36295c-68a5-4281-9c94-503475f067ac', 'ip', 'route', 'get', '192.168.1.6'] >2014-09-02 08:53:47.455 19027 TRACE neutron.services.vpn.device_drivers.ipsec Exit code: 2 >2014-09-02 08:53:47.455 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stdout: '' >2014-09-02 08:53:47.455 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stderr: 'RTNETLINK answers: Network is unreachable\n' >2014-09-02 08:53:47.455 19027 TRACE neutron.services.vpn.device_drivers.ipsec >2014-09-02 08:53:50.222 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 08:53:50.222 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 08:53:50.222 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 08:53:50.222 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 08:53:50.222 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 08:53:50.222 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 08:53:50.222 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 08:53:50.222 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 08:53:50.222 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 08:53:50.222 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 08:53:50.222 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 08:53:50.222 19027 TRACE neutron.agent.l3_agent >2014-09-02 08:54:30.223 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 08:54:30.223 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 08:54:30.223 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 08:54:30.223 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 08:54:30.223 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 08:54:30.223 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 08:54:30.223 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 08:54:30.223 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 08:54:30.223 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 08:54:30.223 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 08:54:30.223 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 08:54:30.223 19027 TRACE neutron.agent.l3_agent >2014-09-02 08:55:10.226 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 08:55:10.226 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 08:55:10.226 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 08:55:10.226 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 08:55:10.226 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 08:55:10.226 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 08:55:10.226 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 08:55:10.226 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 08:55:10.226 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 08:55:10.226 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 08:55:10.226 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 08:55:10.226 19027 TRACE neutron.agent.l3_agent >2014-09-02 08:55:50.224 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 08:55:50.224 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 08:55:50.224 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 08:55:50.224 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 08:55:50.224 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 08:55:50.224 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 08:55:50.224 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 08:55:50.224 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 08:55:50.224 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 08:55:50.224 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 08:55:50.224 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 08:55:50.224 19027 TRACE neutron.agent.l3_agent >2014-09-02 08:56:30.263 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 08:56:30.263 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 08:56:30.263 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 08:56:30.263 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 08:56:30.263 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 08:56:30.263 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 08:56:30.263 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 08:56:30.263 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 08:56:30.263 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 08:56:30.263 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 08:56:30.263 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 08:56:30.263 19027 TRACE neutron.agent.l3_agent >2014-09-02 08:57:10.229 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 08:57:10.229 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 08:57:10.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 08:57:10.229 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 08:57:10.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 08:57:10.229 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 08:57:10.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 08:57:10.229 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 08:57:10.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 08:57:10.229 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 08:57:10.229 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 08:57:10.229 19027 TRACE neutron.agent.l3_agent >2014-09-02 08:57:50.224 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 08:57:50.224 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 08:57:50.224 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 08:57:50.224 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 08:57:50.224 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 08:57:50.224 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 08:57:50.224 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 08:57:50.224 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 08:57:50.224 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 08:57:50.224 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 08:57:50.224 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 08:57:50.224 19027 TRACE neutron.agent.l3_agent >2014-09-02 08:58:30.224 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 08:58:30.224 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 08:58:30.224 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 08:58:30.224 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 08:58:30.224 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 08:58:30.224 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 08:58:30.224 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 08:58:30.224 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 08:58:30.224 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 08:58:30.224 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 08:58:30.224 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 08:58:30.224 19027 TRACE neutron.agent.l3_agent >2014-09-02 08:59:10.354 19027 INFO neutron.agent.linux.interface [-] Device qg-58742a4d-42 already exists >2014-09-02 08:59:10.362 19027 INFO neutron.agent.linux.interface [-] Device qg-9ea1b1e4-ff already exists >2014-09-02 08:59:10.901 19027 ERROR neutron.services.vpn.device_drivers.ipsec [-] Failed to enable vpn process on router 6fbb2b8d-fb48-46f5-a093-5b2653161523 >2014-09-02 08:59:10.901 19027 TRACE neutron.services.vpn.device_drivers.ipsec Traceback (most recent call last): >2014-09-02 08:59:10.901 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 247, in enable >2014-09-02 08:59:10.901 19027 TRACE neutron.services.vpn.device_drivers.ipsec self.start() >2014-09-02 08:59:10.901 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 388, in start >2014-09-02 08:59:10.901 19027 TRACE neutron.services.vpn.device_drivers.ipsec '--virtual_private', virtual_private >2014-09-02 08:59:10.901 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 317, in _execute >2014-09-02 08:59:10.901 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 08:59:10.901 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 467, in execute >2014-09-02 08:59:10.901 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 08:59:10.901 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-09-02 08:59:10.901 19027 TRACE neutron.services.vpn.device_drivers.ipsec raise RuntimeError(m) >2014-09-02 08:59:10.901 19027 TRACE neutron.services.vpn.device_drivers.ipsec RuntimeError: >2014-09-02 08:59:10.901 19027 TRACE neutron.services.vpn.device_drivers.ipsec Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-6fbb2b8d-fb48-46f5-a093-5b2653161523', 'ipsec', 'pluto', '--ctlbase', '/var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/var/run/pluto', '--ipsecdir', '/var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/etc', '--use-netkey', '--uniqueids', '--nat_traversal', '--secretsfile', '/var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/etc/ipsec.secrets', '--virtual_private', '%v4:20.20.20.0/24,%v4:10.10.10.0/24'] >2014-09-02 08:59:10.901 19027 TRACE neutron.services.vpn.device_drivers.ipsec Exit code: 10 >2014-09-02 08:59:10.901 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stdout: '' >2014-09-02 08:59:10.901 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stderr: 'adjusting ipsec.d to /var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/etc\npluto: lock file "/var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/var/run/pluto.pid" already exists\n' >2014-09-02 08:59:10.901 19027 TRACE neutron.services.vpn.device_drivers.ipsec >2014-09-02 08:59:11.222 19027 ERROR neutron.services.vpn.device_drivers.ipsec [-] Failed to enable vpn process on router 4b36295c-68a5-4281-9c94-503475f067ac >2014-09-02 08:59:11.222 19027 TRACE neutron.services.vpn.device_drivers.ipsec Traceback (most recent call last): >2014-09-02 08:59:11.222 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 245, in enable >2014-09-02 08:59:11.222 19027 TRACE neutron.services.vpn.device_drivers.ipsec self.restart() >2014-09-02 08:59:11.222 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 345, in restart >2014-09-02 08:59:11.222 19027 TRACE neutron.services.vpn.device_drivers.ipsec self.start() >2014-09-02 08:59:11.222 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 388, in start >2014-09-02 08:59:11.222 19027 TRACE neutron.services.vpn.device_drivers.ipsec '--virtual_private', virtual_private >2014-09-02 08:59:11.222 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 317, in _execute >2014-09-02 08:59:11.222 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 08:59:11.222 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 467, in execute >2014-09-02 08:59:11.222 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 08:59:11.222 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-09-02 08:59:11.222 19027 TRACE neutron.services.vpn.device_drivers.ipsec raise RuntimeError(m) >2014-09-02 08:59:11.222 19027 TRACE neutron.services.vpn.device_drivers.ipsec RuntimeError: >2014-09-02 08:59:11.222 19027 TRACE neutron.services.vpn.device_drivers.ipsec Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-4b36295c-68a5-4281-9c94-503475f067ac', 'ipsec', 'pluto', '--ctlbase', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto', '--ipsecdir', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc', '--use-netkey', '--uniqueids', '--nat_traversal', '--secretsfile', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc/ipsec.secrets', '--virtual_private', '%v4:10.10.10.0/24,%v4:20.20.20.0/24'] >2014-09-02 08:59:11.222 19027 TRACE neutron.services.vpn.device_drivers.ipsec Exit code: 10 >2014-09-02 08:59:11.222 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stdout: '' >2014-09-02 08:59:11.222 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stderr: 'adjusting ipsec.d to /var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc\npluto: lock file "/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto.pid" already exists\n' >2014-09-02 08:59:11.222 19027 TRACE neutron.services.vpn.device_drivers.ipsec >2014-09-02 09:04:13.755 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:04:13.755 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:04:13.755 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 830, in _rpc_loop >2014-09-02 09:04:13.755 19027 TRACE neutron.agent.l3_agent self._process_routers(routers) >2014-09-02 09:04:13.755 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:04:13.755 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:04:13.755 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:04:13.755 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:04:13.755 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:04:13.755 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:04:13.755 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:04:13.755 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:04:30.235 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:04:30.235 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:04:30.235 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:04:30.235 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:04:30.235 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:04:30.235 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:04:30.235 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:04:30.235 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:04:30.235 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:04:30.235 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:04:30.235 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:04:30.235 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:04:41.241 19027 ERROR neutron.services.vpn.device_drivers.ipsec [-] Failed to enable vpn process on router 6fbb2b8d-fb48-46f5-a093-5b2653161523 >2014-09-02 09:04:41.241 19027 TRACE neutron.services.vpn.device_drivers.ipsec Traceback (most recent call last): >2014-09-02 09:04:41.241 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 247, in enable >2014-09-02 09:04:41.241 19027 TRACE neutron.services.vpn.device_drivers.ipsec self.start() >2014-09-02 09:04:41.241 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 388, in start >2014-09-02 09:04:41.241 19027 TRACE neutron.services.vpn.device_drivers.ipsec '--virtual_private', virtual_private >2014-09-02 09:04:41.241 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 317, in _execute >2014-09-02 09:04:41.241 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 09:04:41.241 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 467, in execute >2014-09-02 09:04:41.241 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 09:04:41.241 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-09-02 09:04:41.241 19027 TRACE neutron.services.vpn.device_drivers.ipsec raise RuntimeError(m) >2014-09-02 09:04:41.241 19027 TRACE neutron.services.vpn.device_drivers.ipsec RuntimeError: >2014-09-02 09:04:41.241 19027 TRACE neutron.services.vpn.device_drivers.ipsec Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-6fbb2b8d-fb48-46f5-a093-5b2653161523', 'ipsec', 'pluto', '--ctlbase', '/var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/var/run/pluto', '--ipsecdir', '/var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/etc', '--use-netkey', '--uniqueids', '--nat_traversal', '--secretsfile', '/var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/etc/ipsec.secrets', '--virtual_private', '%v4:20.20.20.0/24,%v4:10.10.10.0/24'] >2014-09-02 09:04:41.241 19027 TRACE neutron.services.vpn.device_drivers.ipsec Exit code: 10 >2014-09-02 09:04:41.241 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stdout: '' >2014-09-02 09:04:41.241 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stderr: 'adjusting ipsec.d to /var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/etc\npluto: lock file "/var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/var/run/pluto.pid" already exists\n' >2014-09-02 09:04:41.241 19027 TRACE neutron.services.vpn.device_drivers.ipsec >2014-09-02 09:04:41.478 19027 ERROR neutron.services.vpn.device_drivers.ipsec [-] Failed to enable vpn process on router 4b36295c-68a5-4281-9c94-503475f067ac >2014-09-02 09:04:41.478 19027 TRACE neutron.services.vpn.device_drivers.ipsec Traceback (most recent call last): >2014-09-02 09:04:41.478 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 247, in enable >2014-09-02 09:04:41.478 19027 TRACE neutron.services.vpn.device_drivers.ipsec self.start() >2014-09-02 09:04:41.478 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 388, in start >2014-09-02 09:04:41.478 19027 TRACE neutron.services.vpn.device_drivers.ipsec '--virtual_private', virtual_private >2014-09-02 09:04:41.478 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 317, in _execute >2014-09-02 09:04:41.478 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 09:04:41.478 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 467, in execute >2014-09-02 09:04:41.478 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 09:04:41.478 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-09-02 09:04:41.478 19027 TRACE neutron.services.vpn.device_drivers.ipsec raise RuntimeError(m) >2014-09-02 09:04:41.478 19027 TRACE neutron.services.vpn.device_drivers.ipsec RuntimeError: >2014-09-02 09:04:41.478 19027 TRACE neutron.services.vpn.device_drivers.ipsec Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-4b36295c-68a5-4281-9c94-503475f067ac', 'ipsec', 'pluto', '--ctlbase', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto', '--ipsecdir', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc', '--use-netkey', '--uniqueids', '--nat_traversal', '--secretsfile', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc/ipsec.secrets', '--virtual_private', '%v4:10.10.10.0/24,%v4:20.20.20.0/24'] >2014-09-02 09:04:41.478 19027 TRACE neutron.services.vpn.device_drivers.ipsec Exit code: 10 >2014-09-02 09:04:41.478 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stdout: '' >2014-09-02 09:04:41.478 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stderr: 'adjusting ipsec.d to /var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc\npluto: lock file "/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto.pid" already exists\n' >2014-09-02 09:04:41.478 19027 TRACE neutron.services.vpn.device_drivers.ipsec >2014-09-02 09:04:55.766 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:04:55.766 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:04:55.766 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 830, in _rpc_loop >2014-09-02 09:04:55.766 19027 TRACE neutron.agent.l3_agent self._process_routers(routers) >2014-09-02 09:04:55.766 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:04:55.766 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:04:55.766 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:04:55.766 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:04:55.766 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:04:55.766 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:04:55.766 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:04:55.766 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:05:10.231 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:05:10.231 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:05:10.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:05:10.231 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:05:10.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:05:10.231 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:05:10.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:05:10.231 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:05:10.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:05:10.231 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:05:10.231 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:05:10.231 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:05:50.225 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:05:50.225 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:05:50.225 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:05:50.225 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:05:50.225 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:05:50.225 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:05:50.225 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:05:50.225 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:05:50.225 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:05:50.225 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:05:50.225 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:05:50.225 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:06:18.220 19027 ERROR neutron.services.vpn.device_drivers.ipsec [req-03402698-0943-40a3-8a41-212ea51b1797 None] Failed to enable vpn process on router 4b36295c-68a5-4281-9c94-503475f067ac >2014-09-02 09:06:18.220 19027 TRACE neutron.services.vpn.device_drivers.ipsec Traceback (most recent call last): >2014-09-02 09:06:18.220 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 247, in enable >2014-09-02 09:06:18.220 19027 TRACE neutron.services.vpn.device_drivers.ipsec self.start() >2014-09-02 09:06:18.220 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 388, in start >2014-09-02 09:06:18.220 19027 TRACE neutron.services.vpn.device_drivers.ipsec '--virtual_private', virtual_private >2014-09-02 09:06:18.220 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 317, in _execute >2014-09-02 09:06:18.220 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 09:06:18.220 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 467, in execute >2014-09-02 09:06:18.220 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 09:06:18.220 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-09-02 09:06:18.220 19027 TRACE neutron.services.vpn.device_drivers.ipsec raise RuntimeError(m) >2014-09-02 09:06:18.220 19027 TRACE neutron.services.vpn.device_drivers.ipsec RuntimeError: >2014-09-02 09:06:18.220 19027 TRACE neutron.services.vpn.device_drivers.ipsec Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-4b36295c-68a5-4281-9c94-503475f067ac', 'ipsec', 'pluto', '--ctlbase', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto', '--ipsecdir', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc', '--use-netkey', '--uniqueids', '--nat_traversal', '--secretsfile', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc/ipsec.secrets', '--virtual_private', '%v4:10.10.10.0/24,%v4:20.20.20.0/24'] >2014-09-02 09:06:18.220 19027 TRACE neutron.services.vpn.device_drivers.ipsec Exit code: 10 >2014-09-02 09:06:18.220 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stdout: '' >2014-09-02 09:06:18.220 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stderr: 'adjusting ipsec.d to /var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc\npluto: lock file "/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto.pid" already exists\n' >2014-09-02 09:06:18.220 19027 TRACE neutron.services.vpn.device_drivers.ipsec >2014-09-02 09:06:18.321 19027 WARNING neutron.agent.linux.iptables_manager [req-03402698-0943-40a3-8a41-212ea51b1797 None] Tried to remove rule that was not there: 'POSTROUTING' u'-s 20.20.20.0/24 -d 10.10.10.0/24 -m policy --dir out --pol ipsec -j ACCEPT ' True False >2014-09-02 09:06:30.227 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:06:30.227 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:06:30.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:06:30.227 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:06:30.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:06:30.227 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:06:30.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:06:30.227 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:06:30.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:06:30.227 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:06:30.227 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:06:30.227 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:06:42.623 19027 WARNING neutron.agent.linux.iptables_manager [req-3eb38b00-8f99-4ec9-b205-635af1bf7907 None] Tried to remove rule that was not there: 'POSTROUTING' u'-s 10.10.10.0/24 -d 20.20.20.0/24 -m policy --dir out --pol ipsec -j ACCEPT ' True False >2014-09-02 09:07:10.227 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:07:10.227 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:07:10.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:07:10.227 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:07:10.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:07:10.227 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:07:10.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:07:10.227 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:07:10.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:07:10.227 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:07:10.227 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:07:10.227 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:07:23.107 19027 ERROR neutron.services.vpn.device_drivers.ipsec [req-c5b65433-7166-475d-9102-e1211763c19b None] Failed to enable vpn process on router 4b36295c-68a5-4281-9c94-503475f067ac >2014-09-02 09:07:23.107 19027 TRACE neutron.services.vpn.device_drivers.ipsec Traceback (most recent call last): >2014-09-02 09:07:23.107 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 247, in enable >2014-09-02 09:07:23.107 19027 TRACE neutron.services.vpn.device_drivers.ipsec self.start() >2014-09-02 09:07:23.107 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 392, in start >2014-09-02 09:07:23.107 19027 TRACE neutron.services.vpn.device_drivers.ipsec nexthop = self._get_nexthop(ipsec_site_conn['peer_address']) >2014-09-02 09:07:23.107 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 350, in _get_nexthop >2014-09-02 09:07:23.107 19027 TRACE neutron.services.vpn.device_drivers.ipsec ['ip', 'route', 'get', address]) >2014-09-02 09:07:23.107 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 317, in _execute >2014-09-02 09:07:23.107 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 09:07:23.107 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 467, in execute >2014-09-02 09:07:23.107 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 09:07:23.107 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-09-02 09:07:23.107 19027 TRACE neutron.services.vpn.device_drivers.ipsec raise RuntimeError(m) >2014-09-02 09:07:23.107 19027 TRACE neutron.services.vpn.device_drivers.ipsec RuntimeError: >2014-09-02 09:07:23.107 19027 TRACE neutron.services.vpn.device_drivers.ipsec Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-4b36295c-68a5-4281-9c94-503475f067ac', 'ip', 'route', 'get', '10.35.31.194'] >2014-09-02 09:07:23.107 19027 TRACE neutron.services.vpn.device_drivers.ipsec Exit code: 2 >2014-09-02 09:07:23.107 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stdout: '' >2014-09-02 09:07:23.107 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stderr: 'RTNETLINK answers: Network is unreachable\n' >2014-09-02 09:07:23.107 19027 TRACE neutron.services.vpn.device_drivers.ipsec >2014-09-02 09:07:50.226 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:07:50.226 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:07:50.226 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:07:50.226 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:07:50.226 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:07:50.226 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:07:50.226 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:07:50.226 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:07:50.226 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:07:50.226 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:07:50.226 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:07:50.226 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:08:09.706 19027 ERROR neutron.services.vpn.device_drivers.ipsec [req-4b34142c-9194-46df-938f-53c8341d2252 None] Failed to enable vpn process on router 6fbb2b8d-fb48-46f5-a093-5b2653161523 >2014-09-02 09:08:09.706 19027 TRACE neutron.services.vpn.device_drivers.ipsec Traceback (most recent call last): >2014-09-02 09:08:09.706 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 247, in enable >2014-09-02 09:08:09.706 19027 TRACE neutron.services.vpn.device_drivers.ipsec self.start() >2014-09-02 09:08:09.706 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 392, in start >2014-09-02 09:08:09.706 19027 TRACE neutron.services.vpn.device_drivers.ipsec nexthop = self._get_nexthop(ipsec_site_conn['peer_address']) >2014-09-02 09:08:09.706 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 350, in _get_nexthop >2014-09-02 09:08:09.706 19027 TRACE neutron.services.vpn.device_drivers.ipsec ['ip', 'route', 'get', address]) >2014-09-02 09:08:09.706 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 317, in _execute >2014-09-02 09:08:09.706 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 09:08:09.706 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 467, in execute >2014-09-02 09:08:09.706 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 09:08:09.706 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-09-02 09:08:09.706 19027 TRACE neutron.services.vpn.device_drivers.ipsec raise RuntimeError(m) >2014-09-02 09:08:09.706 19027 TRACE neutron.services.vpn.device_drivers.ipsec RuntimeError: >2014-09-02 09:08:09.706 19027 TRACE neutron.services.vpn.device_drivers.ipsec Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-6fbb2b8d-fb48-46f5-a093-5b2653161523', 'ip', 'route', 'get', '10.35.31.193'] >2014-09-02 09:08:09.706 19027 TRACE neutron.services.vpn.device_drivers.ipsec Exit code: 2 >2014-09-02 09:08:09.706 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stdout: '' >2014-09-02 09:08:09.706 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stderr: 'RTNETLINK answers: Network is unreachable\n' >2014-09-02 09:08:09.706 19027 TRACE neutron.services.vpn.device_drivers.ipsec >2014-09-02 09:08:10.012 19027 ERROR neutron.services.vpn.device_drivers.ipsec [req-4b34142c-9194-46df-938f-53c8341d2252 None] Failed to enable vpn process on router 4b36295c-68a5-4281-9c94-503475f067ac >2014-09-02 09:08:10.012 19027 TRACE neutron.services.vpn.device_drivers.ipsec Traceback (most recent call last): >2014-09-02 09:08:10.012 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 245, in enable >2014-09-02 09:08:10.012 19027 TRACE neutron.services.vpn.device_drivers.ipsec self.restart() >2014-09-02 09:08:10.012 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 345, in restart >2014-09-02 09:08:10.012 19027 TRACE neutron.services.vpn.device_drivers.ipsec self.start() >2014-09-02 09:08:10.012 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 388, in start >2014-09-02 09:08:10.012 19027 TRACE neutron.services.vpn.device_drivers.ipsec '--virtual_private', virtual_private >2014-09-02 09:08:10.012 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 317, in _execute >2014-09-02 09:08:10.012 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 09:08:10.012 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 467, in execute >2014-09-02 09:08:10.012 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 09:08:10.012 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-09-02 09:08:10.012 19027 TRACE neutron.services.vpn.device_drivers.ipsec raise RuntimeError(m) >2014-09-02 09:08:10.012 19027 TRACE neutron.services.vpn.device_drivers.ipsec RuntimeError: >2014-09-02 09:08:10.012 19027 TRACE neutron.services.vpn.device_drivers.ipsec Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-4b36295c-68a5-4281-9c94-503475f067ac', 'ipsec', 'pluto', '--ctlbase', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto', '--ipsecdir', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc', '--use-netkey', '--uniqueids', '--nat_traversal', '--secretsfile', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc/ipsec.secrets', '--virtual_private', '%v4:10.10.10.0/24,%v4:20.20.20.0/24'] >2014-09-02 09:08:10.012 19027 TRACE neutron.services.vpn.device_drivers.ipsec Exit code: 10 >2014-09-02 09:08:10.012 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stdout: '' >2014-09-02 09:08:10.012 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stderr: 'adjusting ipsec.d to /var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc\npluto: lock file "/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto.pid" already exists\n' >2014-09-02 09:08:10.012 19027 TRACE neutron.services.vpn.device_drivers.ipsec >2014-09-02 09:08:30.228 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:08:30.228 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:08:30.228 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:08:30.228 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:08:30.228 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:08:30.228 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:08:30.228 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:08:30.228 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:08:30.228 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:08:30.228 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:08:30.228 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:08:30.228 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:09:10.236 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:09:10.236 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:09:10.236 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:09:10.236 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:09:10.236 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:09:10.236 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:09:10.236 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:09:10.236 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:09:10.236 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:09:10.236 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:09:10.236 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:09:10.236 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:09:50.272 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:09:50.272 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:09:50.272 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:09:50.272 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:09:50.272 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:09:50.272 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:09:50.272 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:09:50.272 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:09:50.272 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:09:50.272 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:09:50.272 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:09:50.272 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:10:30.225 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:10:30.225 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:10:30.225 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:10:30.225 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:10:30.225 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:10:30.225 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:10:30.225 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:10:30.225 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:10:30.225 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:10:30.225 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:10:30.225 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:10:30.225 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:11:10.231 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:11:10.231 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:11:10.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:11:10.231 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:11:10.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:11:10.231 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:11:10.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:11:10.231 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:11:10.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:11:10.231 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:11:10.231 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:11:10.231 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:11:50.230 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:11:50.230 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:11:50.230 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:11:50.230 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:11:50.230 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:11:50.230 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:11:50.230 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:11:50.230 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:11:50.230 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:11:50.230 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:11:50.230 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:11:50.230 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:12:30.226 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:12:30.226 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:12:30.226 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:12:30.226 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:12:30.226 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:12:30.226 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:12:30.226 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:12:30.226 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:12:30.226 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:12:30.226 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:12:30.226 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:12:30.226 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:13:10.238 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:13:10.238 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:13:10.238 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:13:10.238 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:13:10.238 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:13:10.238 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:13:10.238 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:13:10.238 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:13:10.238 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:13:10.238 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:13:10.238 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:13:10.238 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:13:50.231 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:13:50.231 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:13:50.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:13:50.231 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:13:50.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:13:50.231 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:13:50.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:13:50.231 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:13:50.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:13:50.231 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:13:50.231 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:13:50.231 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:14:30.227 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:14:30.227 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:14:30.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:14:30.227 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:14:30.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:14:30.227 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:14:30.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:14:30.227 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:14:30.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:14:30.227 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:14:30.227 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:14:30.227 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:15:10.251 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:15:10.251 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:15:10.251 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:15:10.251 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:15:10.251 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:15:10.251 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:15:10.251 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:15:10.251 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:15:10.251 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:15:10.251 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:15:10.251 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:15:10.251 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:15:50.229 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:15:50.229 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:15:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:15:50.229 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:15:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:15:50.229 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:15:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:15:50.229 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:15:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:15:50.229 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:15:50.229 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:15:50.229 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:16:30.226 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:16:30.226 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:16:30.226 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:16:30.226 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:16:30.226 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:16:30.226 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:16:30.226 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:16:30.226 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:16:30.226 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:16:30.226 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:16:30.226 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:16:30.226 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:17:10.231 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:17:10.231 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:17:10.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:17:10.231 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:17:10.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:17:10.231 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:17:10.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:17:10.231 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:17:10.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:17:10.231 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:17:10.231 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:17:10.231 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:17:50.225 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:17:50.225 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:17:50.225 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:17:50.225 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:17:50.225 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:17:50.225 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:17:50.225 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:17:50.225 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:17:50.225 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:17:50.225 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:17:50.225 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:17:50.225 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:18:30.227 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:18:30.227 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:18:30.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:18:30.227 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:18:30.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:18:30.227 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:18:30.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:18:30.227 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:18:30.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:18:30.227 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:18:30.227 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:18:30.227 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:19:10.231 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:19:10.231 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:19:10.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:19:10.231 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:19:10.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:19:10.231 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:19:10.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:19:10.231 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:19:10.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:19:10.231 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:19:10.231 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:19:10.231 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:19:50.229 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:19:50.229 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:19:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:19:50.229 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:19:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:19:50.229 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:19:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:19:50.229 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:19:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:19:50.229 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:19:50.229 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:19:50.229 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:20:30.230 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:20:30.230 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:20:30.230 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:20:30.230 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:20:30.230 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:20:30.230 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:20:30.230 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:20:30.230 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:20:30.230 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:20:30.230 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:20:30.230 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:20:30.230 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:21:10.234 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:21:10.234 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:21:10.234 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:21:10.234 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:21:10.234 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:21:10.234 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:21:10.234 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:21:10.234 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:21:10.234 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:21:10.234 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:21:10.234 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:21:10.234 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:21:50.229 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:21:50.229 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:21:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:21:50.229 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:21:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:21:50.229 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:21:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:21:50.229 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:21:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:21:50.229 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:21:50.229 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:21:50.229 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:22:30.229 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:22:30.229 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:22:30.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:22:30.229 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:22:30.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:22:30.229 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:22:30.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:22:30.229 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:22:30.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:22:30.229 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:22:30.229 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:22:30.229 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:23:10.294 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:23:10.294 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:23:10.294 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:23:10.294 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:23:10.294 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:23:10.294 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:23:10.294 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:23:10.294 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:23:10.294 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:23:10.294 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:23:10.294 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:23:10.294 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:23:50.229 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:23:50.229 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:23:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:23:50.229 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:23:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:23:50.229 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:23:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:23:50.229 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:23:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:23:50.229 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:23:50.229 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:23:50.229 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:24:30.229 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:24:30.229 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:24:30.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:24:30.229 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:24:30.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:24:30.229 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:24:30.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:24:30.229 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:24:30.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:24:30.229 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:24:30.229 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:24:30.229 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:25:10.235 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:25:10.235 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:25:10.235 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:25:10.235 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:25:10.235 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:25:10.235 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:25:10.235 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:25:10.235 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:25:10.235 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:25:10.235 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:25:10.235 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:25:10.235 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:25:50.231 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:25:50.231 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:25:50.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:25:50.231 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:25:50.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:25:50.231 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:25:50.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:25:50.231 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:25:50.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:25:50.231 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:25:50.231 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:25:50.231 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:26:30.227 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:26:30.227 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:26:30.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:26:30.227 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:26:30.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:26:30.227 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:26:30.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:26:30.227 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:26:30.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:26:30.227 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:26:30.227 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:26:30.227 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:27:10.235 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:27:10.235 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:27:10.235 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:27:10.235 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:27:10.235 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:27:10.235 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:27:10.235 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:27:10.235 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:27:10.235 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:27:10.235 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:27:10.235 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:27:10.235 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:27:50.227 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:27:50.227 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:27:50.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:27:50.227 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:27:50.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:27:50.227 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:27:50.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:27:50.227 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:27:50.227 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:27:50.227 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:27:50.227 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:27:50.227 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:28:30.230 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:28:30.230 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:28:30.230 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:28:30.230 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:28:30.230 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:28:30.230 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:28:30.230 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:28:30.230 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:28:30.230 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:28:30.230 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:28:30.230 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:28:30.230 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:29:10.233 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:29:10.233 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:29:10.233 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:29:10.233 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:29:10.233 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:29:10.233 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:29:10.233 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:29:10.233 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:29:10.233 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:29:10.233 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:29:10.233 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:29:10.233 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:29:50.229 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:29:50.229 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:29:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:29:50.229 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:29:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:29:50.229 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:29:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:29:50.229 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:29:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:29:50.229 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:29:50.229 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:29:50.229 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:30:30.232 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:30:30.232 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:30:30.232 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:30:30.232 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:30:30.232 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:30:30.232 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:30:30.232 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:30:30.232 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:30:30.232 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:30:30.232 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:30:30.232 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:30:30.232 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:31:10.230 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:31:10.230 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:31:10.230 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:31:10.230 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:31:10.230 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:31:10.230 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:31:10.230 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:31:10.230 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:31:10.230 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:31:10.230 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:31:10.230 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:31:10.230 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:31:50.273 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:31:50.273 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:31:50.273 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:31:50.273 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:31:50.273 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:31:50.273 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:31:50.273 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:31:50.273 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:31:50.273 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:31:50.273 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:31:50.273 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:31:50.273 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:32:30.229 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:32:30.229 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:32:30.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:32:30.229 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:32:30.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:32:30.229 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:32:30.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:32:30.229 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:32:30.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:32:30.229 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:32:30.229 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:32:30.229 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:33:10.250 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:33:10.250 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:33:10.250 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:33:10.250 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:33:10.250 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:33:10.250 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:33:10.250 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:33:10.250 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:33:10.250 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:33:10.250 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:33:10.250 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:33:10.250 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:33:50.229 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:33:50.229 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:33:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:33:50.229 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:33:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:33:50.229 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:33:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:33:50.229 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:33:50.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:33:50.229 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:33:50.229 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:33:50.229 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:34:30.229 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:34:30.229 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:34:30.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:34:30.229 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:34:30.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:34:30.229 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:34:30.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:34:30.229 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:34:30.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:34:30.229 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:34:30.229 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:34:30.229 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:35:10.233 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:35:10.233 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:35:10.233 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:35:10.233 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:35:10.233 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:35:10.233 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:35:10.233 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:35:10.233 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:35:10.233 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:35:10.233 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:35:10.233 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:35:10.233 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:35:50.231 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:35:50.231 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:35:50.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:35:50.231 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:35:50.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:35:50.231 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:35:50.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:35:50.231 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:35:50.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:35:50.231 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:35:50.231 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:35:50.231 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:36:30.229 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:36:30.229 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:36:30.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:36:30.229 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:36:30.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:36:30.229 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:36:30.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:36:30.229 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:36:30.229 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:36:30.229 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:36:30.229 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:36:30.229 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:37:10.233 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:37:10.233 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:37:10.233 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:37:10.233 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:37:10.233 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:37:10.233 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:37:10.233 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:37:10.233 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:37:10.233 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:37:10.233 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:37:10.233 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:37:10.233 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:37:50.231 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:37:50.231 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:37:50.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:37:50.231 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:37:50.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:37:50.231 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:37:50.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:37:50.231 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:37:50.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:37:50.231 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:37:50.231 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:37:50.231 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:38:30.230 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:38:30.230 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:38:30.230 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:38:30.230 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:38:30.230 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:38:30.230 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:38:30.230 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:38:30.230 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:38:30.230 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:38:30.230 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:38:30.230 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:38:30.230 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:39:10.240 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:39:10.240 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:39:10.240 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:39:10.240 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:39:10.240 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:39:10.240 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:39:10.240 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:39:10.240 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:39:10.240 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:39:10.240 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:39:10.240 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:39:10.240 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:39:50.231 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:39:50.231 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:39:50.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:39:50.231 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:39:50.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:39:50.231 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:39:50.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:39:50.231 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:39:50.231 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:39:50.231 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:39:50.231 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:39:50.231 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:40:30.251 19027 ERROR neutron.agent.l3_agent [-] Failed synchronizing routers >2014-09-02 09:40:30.251 19027 TRACE neutron.agent.l3_agent Traceback (most recent call last): >2014-09-02 09:40:30.251 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 864, in _sync_routers_task >2014-09-02 09:40:30.251 19027 TRACE neutron.agent.l3_agent self._process_routers(routers, all_routers=True) >2014-09-02 09:40:30.251 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/services/vpn/agent.py", line 141, in _process_routers >2014-09-02 09:40:30.251 19027 TRACE neutron.agent.l3_agent super(VPNAgent, self)._process_routers(routers, all_routers) >2014-09-02 09:40:30.251 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 793, in _process_routers >2014-09-02 09:40:30.251 19027 TRACE neutron.agent.l3_agent if (ex_net_id != self._fetch_external_net_id(force=True)): >2014-09-02 09:40:30.251 19027 TRACE neutron.agent.l3_agent File "/usr/lib/python2.6/site-packages/neutron/agent/l3_agent.py", line 337, in _fetch_external_net_id >2014-09-02 09:40:30.251 19027 TRACE neutron.agent.l3_agent raise Exception(msg) >2014-09-02 09:40:30.251 19027 TRACE neutron.agent.l3_agent Exception: The 'gateway_external_network_id' option must be configured for this agent as Neutron has more than one external network. >2014-09-02 09:40:30.251 19027 TRACE neutron.agent.l3_agent >2014-09-02 09:41:10.814 19027 ERROR neutron.services.vpn.device_drivers.ipsec [-] Failed to enable vpn process on router 6fbb2b8d-fb48-46f5-a093-5b2653161523 >2014-09-02 09:41:10.814 19027 TRACE neutron.services.vpn.device_drivers.ipsec Traceback (most recent call last): >2014-09-02 09:41:10.814 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 245, in enable >2014-09-02 09:41:10.814 19027 TRACE neutron.services.vpn.device_drivers.ipsec self.restart() >2014-09-02 09:41:10.814 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 345, in restart >2014-09-02 09:41:10.814 19027 TRACE neutron.services.vpn.device_drivers.ipsec self.start() >2014-09-02 09:41:10.814 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 388, in start >2014-09-02 09:41:10.814 19027 TRACE neutron.services.vpn.device_drivers.ipsec '--virtual_private', virtual_private >2014-09-02 09:41:10.814 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 317, in _execute >2014-09-02 09:41:10.814 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 09:41:10.814 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 467, in execute >2014-09-02 09:41:10.814 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 09:41:10.814 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-09-02 09:41:10.814 19027 TRACE neutron.services.vpn.device_drivers.ipsec raise RuntimeError(m) >2014-09-02 09:41:10.814 19027 TRACE neutron.services.vpn.device_drivers.ipsec RuntimeError: >2014-09-02 09:41:10.814 19027 TRACE neutron.services.vpn.device_drivers.ipsec Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-6fbb2b8d-fb48-46f5-a093-5b2653161523', 'ipsec', 'pluto', '--ctlbase', '/var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/var/run/pluto', '--ipsecdir', '/var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/etc', '--use-netkey', '--uniqueids', '--nat_traversal', '--secretsfile', '/var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/etc/ipsec.secrets', '--virtual_private', '%v4:20.20.20.0/24,%v4:10.10.10.0/24'] >2014-09-02 09:41:10.814 19027 TRACE neutron.services.vpn.device_drivers.ipsec Exit code: 10 >2014-09-02 09:41:10.814 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stdout: '' >2014-09-02 09:41:10.814 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stderr: 'adjusting ipsec.d to /var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/etc\npluto: lock file "/var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/var/run/pluto.pid" already exists\n' >2014-09-02 09:41:10.814 19027 TRACE neutron.services.vpn.device_drivers.ipsec >2014-09-02 09:41:11.070 19027 ERROR neutron.services.vpn.device_drivers.ipsec [-] Failed to enable vpn process on router 4b36295c-68a5-4281-9c94-503475f067ac >2014-09-02 09:41:11.070 19027 TRACE neutron.services.vpn.device_drivers.ipsec Traceback (most recent call last): >2014-09-02 09:41:11.070 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 247, in enable >2014-09-02 09:41:11.070 19027 TRACE neutron.services.vpn.device_drivers.ipsec self.start() >2014-09-02 09:41:11.070 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 388, in start >2014-09-02 09:41:11.070 19027 TRACE neutron.services.vpn.device_drivers.ipsec '--virtual_private', virtual_private >2014-09-02 09:41:11.070 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 317, in _execute >2014-09-02 09:41:11.070 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 09:41:11.070 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 467, in execute >2014-09-02 09:41:11.070 19027 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 09:41:11.070 19027 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-09-02 09:41:11.070 19027 TRACE neutron.services.vpn.device_drivers.ipsec raise RuntimeError(m) >2014-09-02 09:41:11.070 19027 TRACE neutron.services.vpn.device_drivers.ipsec RuntimeError: >2014-09-02 09:41:11.070 19027 TRACE neutron.services.vpn.device_drivers.ipsec Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-4b36295c-68a5-4281-9c94-503475f067ac', 'ipsec', 'pluto', '--ctlbase', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto', '--ipsecdir', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc', '--use-netkey', '--uniqueids', '--nat_traversal', '--secretsfile', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc/ipsec.secrets', '--virtual_private', '%v4:10.10.10.0/24,%v4:20.20.20.0/24'] >2014-09-02 09:41:11.070 19027 TRACE neutron.services.vpn.device_drivers.ipsec Exit code: 10 >2014-09-02 09:41:11.070 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stdout: '' >2014-09-02 09:41:11.070 19027 TRACE neutron.services.vpn.device_drivers.ipsec Stderr: 'adjusting ipsec.d to /var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc\npluto: lock file "/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto.pid" already exists\n' >2014-09-02 09:41:11.070 19027 TRACE neutron.services.vpn.device_drivers.ipsec >2014-09-02 09:41:11.308 19027 WARNING neutron.openstack.common.loopingcall [-] task run outlasted interval by 0.092462 sec >2014-09-02 10:22:00.129 19027 INFO neutron.openstack.common.service [-] Caught SIGTERM, exiting >2014-09-02 10:22:00.584 28485 INFO neutron.common.config [-] Logging enabled! >2014-09-02 10:22:00.698 28485 INFO neutron.openstack.common.rpc.common [req-fcba9eaf-78cc-4de4-822c-b5507f376f72 None] Connected to AMQP server on 10.35.99.11:5672 >2014-09-02 10:22:00.699 28485 INFO neutron.openstack.common.rpc.common [req-c3a42360-bf88-41db-90b8-f6670f459a5b None] Connected to AMQP server on 10.35.99.11:5672 >2014-09-02 10:22:00.748 28485 INFO neutron.openstack.common.rpc.common [req-c3a42360-bf88-41db-90b8-f6670f459a5b None] Connected to AMQP server on 10.35.99.11:5672 >2014-09-02 10:22:00.749 28485 INFO neutron.openstack.common.rpc.common [req-c3a42360-bf88-41db-90b8-f6670f459a5b None] Connected to AMQP server on 10.35.99.11:5672 >2014-09-02 10:22:00.753 28485 INFO neutron.agent.l3_agent [req-c3a42360-bf88-41db-90b8-f6670f459a5b None] L3 agent started >2014-09-02 10:22:04.365 28485 INFO neutron.agent.linux.interface [-] Device qg-032c5f06-d7 already exists >2014-09-02 10:22:04.737 28485 INFO neutron.agent.linux.interface [-] Device qg-b1e9d2ec-fb already exists >2014-09-02 10:22:05.297 28485 ERROR neutron.services.vpn.device_drivers.ipsec [-] Failed to enable vpn process on router 6fbb2b8d-fb48-46f5-a093-5b2653161523 >2014-09-02 10:22:05.297 28485 TRACE neutron.services.vpn.device_drivers.ipsec Traceback (most recent call last): >2014-09-02 10:22:05.297 28485 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 247, in enable >2014-09-02 10:22:05.297 28485 TRACE neutron.services.vpn.device_drivers.ipsec self.start() >2014-09-02 10:22:05.297 28485 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 388, in start >2014-09-02 10:22:05.297 28485 TRACE neutron.services.vpn.device_drivers.ipsec '--virtual_private', virtual_private >2014-09-02 10:22:05.297 28485 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 317, in _execute >2014-09-02 10:22:05.297 28485 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 10:22:05.297 28485 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 467, in execute >2014-09-02 10:22:05.297 28485 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 10:22:05.297 28485 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-09-02 10:22:05.297 28485 TRACE neutron.services.vpn.device_drivers.ipsec raise RuntimeError(m) >2014-09-02 10:22:05.297 28485 TRACE neutron.services.vpn.device_drivers.ipsec RuntimeError: >2014-09-02 10:22:05.297 28485 TRACE neutron.services.vpn.device_drivers.ipsec Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-6fbb2b8d-fb48-46f5-a093-5b2653161523', 'ipsec', 'pluto', '--ctlbase', '/var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/var/run/pluto', '--ipsecdir', '/var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/etc', '--use-netkey', '--uniqueids', '--nat_traversal', '--secretsfile', '/var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/etc/ipsec.secrets', '--virtual_private', '%v4:20.20.20.0/24,%v4:10.10.10.0/24'] >2014-09-02 10:22:05.297 28485 TRACE neutron.services.vpn.device_drivers.ipsec Exit code: 10 >2014-09-02 10:22:05.297 28485 TRACE neutron.services.vpn.device_drivers.ipsec Stdout: '' >2014-09-02 10:22:05.297 28485 TRACE neutron.services.vpn.device_drivers.ipsec Stderr: 'adjusting ipsec.d to /var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/etc\npluto: lock file "/var/lib/neutron/ipsec/6fbb2b8d-fb48-46f5-a093-5b2653161523/var/run/pluto.pid" already exists\n' >2014-09-02 10:22:05.297 28485 TRACE neutron.services.vpn.device_drivers.ipsec >2014-09-02 10:22:05.594 28485 ERROR neutron.services.vpn.device_drivers.ipsec [-] Failed to enable vpn process on router 4b36295c-68a5-4281-9c94-503475f067ac >2014-09-02 10:22:05.594 28485 TRACE neutron.services.vpn.device_drivers.ipsec Traceback (most recent call last): >2014-09-02 10:22:05.594 28485 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 247, in enable >2014-09-02 10:22:05.594 28485 TRACE neutron.services.vpn.device_drivers.ipsec self.start() >2014-09-02 10:22:05.594 28485 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 388, in start >2014-09-02 10:22:05.594 28485 TRACE neutron.services.vpn.device_drivers.ipsec '--virtual_private', virtual_private >2014-09-02 10:22:05.594 28485 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/services/vpn/device_drivers/ipsec.py", line 317, in _execute >2014-09-02 10:22:05.594 28485 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 10:22:05.594 28485 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 467, in execute >2014-09-02 10:22:05.594 28485 TRACE neutron.services.vpn.device_drivers.ipsec check_exit_code=check_exit_code) >2014-09-02 10:22:05.594 28485 TRACE neutron.services.vpn.device_drivers.ipsec File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 76, in execute >2014-09-02 10:22:05.594 28485 TRACE neutron.services.vpn.device_drivers.ipsec raise RuntimeError(m) >2014-09-02 10:22:05.594 28485 TRACE neutron.services.vpn.device_drivers.ipsec RuntimeError: >2014-09-02 10:22:05.594 28485 TRACE neutron.services.vpn.device_drivers.ipsec Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-4b36295c-68a5-4281-9c94-503475f067ac', 'ipsec', 'pluto', '--ctlbase', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto', '--ipsecdir', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc', '--use-netkey', '--uniqueids', '--nat_traversal', '--secretsfile', '/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc/ipsec.secrets', '--virtual_private', '%v4:10.10.10.0/24,%v4:20.20.20.0/24'] >2014-09-02 10:22:05.594 28485 TRACE neutron.services.vpn.device_drivers.ipsec Exit code: 10 >2014-09-02 10:22:05.594 28485 TRACE neutron.services.vpn.device_drivers.ipsec Stdout: '' >2014-09-02 10:22:05.594 28485 TRACE neutron.services.vpn.device_drivers.ipsec Stderr: 'adjusting ipsec.d to /var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/etc\npluto: lock file "/var/lib/neutron/ipsec/4b36295c-68a5-4281-9c94-503475f067ac/var/run/pluto.pid" already exists\n' >2014-09-02 10:22:05.594 28485 TRACE neutron.services.vpn.device_drivers.ipsec >2014-09-02 10:22:05.923 28485 WARNING neutron.openstack.common.loopingcall [-] task run outlasted interval by 0.229461 sec
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1136309
: 933685