Attachment 654708 Details for Bug 881741 – top 100lines from l3-agent.log just after restarting l3_agent

top 100lines from l3-agent.log just after restarting l3_agent

file_881741.txt (text/plain), 6.03 KB, created by Etsuji Nakai on 2012-11-30 02:28:40 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Etsuji Nakai

Created: 2012-11-30 02:28:40 UTC

Size: 6.03 KB

patch

obsolete

>$ head -100 l3-agent.log 
>2012-11-30 11:06:41    ERROR [quantum.agent.l3_agent] couldn't delete namespace 'qrouter-08ad50c6-4081-45f8-954d-b76595a8bcb9'
>Traceback (most recent call last):
>  File "/usr/lib/python2.7/site-packages/quantum/agent/l3_agent.py", line 139, in _destroy_all_router_namespaces
>    self._destroy_router_namespace(ns)
>  File "/usr/lib/python2.7/site-packages/quantum/agent/l3_agent.py", line 146, in _destroy_router_namespace
>    for d in ns_ip.get_devices(exclude_loopback=True):
>  File "/usr/lib/python2.7/site-packages/quantum/agent/linux/ip_lib.py", line 71, in get_devices
>    self.root_helper, self.namespace)
>  File "/usr/lib/python2.7/site-packages/quantum/agent/linux/ip_lib.py", line 56, in _execute
>    root_helper=root_helper)
>  File "/usr/lib/python2.7/site-packages/quantum/agent/linux/utils.py", line 61, in execute
>    raise RuntimeError(m)
>RuntimeError: 
>Command: ['sudo', 'quantum-rootwrap', '/etc/quantum/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-08ad50c6-4081-45f8-954d-b76595a8bcb9', 'ip', '-o', 'link', 'list']
>Exit code: 1
>Stdout: ''
>Stderr: 'seting the network namespace failed: Invalid argument\n'
>2012-11-30 11:06:44    ERROR [quantum.agent.l3_agent] Error running l3_nat daemon_loop
>Traceback (most recent call last):
>  File "/usr/lib/python2.7/site-packages/quantum/agent/l3_agent.py", line 170, in daemon_loop
>    self.do_single_loop()
>  File "/usr/lib/python2.7/site-packages/quantum/agent/l3_agent.py", line 224, in do_single_loop
>    self._router_added(r['id'])
>  File "/usr/lib/python2.7/site-packages/quantum/agent/l3_agent.py", line 239, in _router_added
>    self._create_router_namespace(ri)
>  File "/usr/lib/python2.7/site-packages/quantum/agent/l3_agent.py", line 161, in _create_router_namespace
>    ip_wrapper.netns.execute(['sysctl', '-w', 'net.ipv4.ip_forward=1'])
>  File "/usr/lib/python2.7/site-packages/quantum/agent/linux/ip_lib.py", line 351, in execute
>    check_exit_code=check_exit_code)
>  File "/usr/lib/python2.7/site-packages/quantum/agent/linux/utils.py", line 61, in execute
>    raise RuntimeError(m)
>RuntimeError: 
>Command: ['sudo', 'quantum-rootwrap', '/etc/quantum/rootwrap.conf', 'ip', 'netns', 'exec', 'qrouter-08ad50c6-4081-45f8-954d-b76595a8bcb9', 'sysctl', '-w', 'net.ipv4.ip_forward=1']
>Exit code: 1
>Stdout: ''
>Stderr: 'seting the network namespace failed: Invalid argument\n'
>2012-11-30 11:06:56    ERROR [quantum.agent.l3_agent] Error running l3_nat daemon_loop
>Traceback (most recent call last):
>  File "/usr/lib/python2.7/site-packages/quantum/agent/l3_agent.py", line 170, in daemon_loop
>    self.do_single_loop()
>  File "/usr/lib/python2.7/site-packages/quantum/agent/l3_agent.py", line 227, in do_single_loop
>    self.process_router(ri)
>  File "/usr/lib/python2.7/site-packages/quantum/agent/l3_agent.py", line 300, in process_router
>    self.external_gateway_added(ri, ex_gw_port, internal_cidrs)
>  File "/usr/lib/python2.7/site-packages/quantum/agent/l3_agent.py", line 379, in external_gateway_added
>    prefix=EXTERNAL_DEV_PREFIX)
>  File "/usr/lib/python2.7/site-packages/quantum/agent/linux/interface.py", line 147, in plug
>    namespace_obj.add_device_to_namespace(device)
>  File "/usr/lib/python2.7/site-packages/quantum/agent/linux/ip_lib.py", line 120, in add_device_to_namespace
>    device.link.set_netns(self.namespace)
>  File "/usr/lib/python2.7/site-packages/quantum/agent/linux/ip_lib.py", line 183, in set_netns
>    self._as_root('set', self.name, 'netns', namespace)
>  File "/usr/lib/python2.7/site-packages/quantum/agent/linux/ip_lib.py", line 158, in _as_root
>    kwargs.get('use_root_namespace', False))
>  File "/usr/lib/python2.7/site-packages/quantum/agent/linux/ip_lib.py", line 45, in _as_root
>    namespace)
>  File "/usr/lib/python2.7/site-packages/quantum/agent/linux/ip_lib.py", line 56, in _execute
>    root_helper=root_helper)
>  File "/usr/lib/python2.7/site-packages/quantum/agent/linux/utils.py", line 61, in execute
>    raise RuntimeError(m)
>RuntimeError: 
>Command: ['sudo', 'quantum-rootwrap', '/etc/quantum/rootwrap.conf', 'ip', 'link', 'set', 'qg-3851239a-5b', 'netns', 'qrouter-08ad50c6-4081-45f8-954d-b76595a8bcb9']
>Exit code: 2
>Stdout: ''
>Stderr: 'RTNETLINK answers: Invalid argument\n'
>2012-11-30 11:07:09    ERROR [quantum.agent.l3_agent] Error running l3_nat daemon_loop
>Traceback (most recent call last):
>  File "/usr/lib/python2.7/site-packages/quantum/agent/l3_agent.py", line 170, in daemon_loop
>    self.do_single_loop()
>  File "/usr/lib/python2.7/site-packages/quantum/agent/l3_agent.py", line 227, in do_single_loop
>    self.process_router(ri)
>  File "/usr/lib/python2.7/site-packages/quantum/agent/l3_agent.py", line 300, in process_router
>    self.external_gateway_added(ri, ex_gw_port, internal_cidrs)
>  File "/usr/lib/python2.7/site-packages/quantum/agent/l3_agent.py", line 379, in external_gateway_added
>    prefix=EXTERNAL_DEV_PREFIX)
>  File "/usr/lib/python2.7/site-packages/quantum/agent/linux/interface.py", line 147, in plug
>    namespace_obj.add_device_to_namespace(device)
>  File "/usr/lib/python2.7/site-packages/quantum/agent/linux/ip_lib.py", line 120, in add_device_to_namespace
>    device.link.set_netns(self.namespace)
>  File "/usr/lib/python2.7/site-packages/quantum/agent/linux/ip_lib.py", line 183, in set_netns
>    self._as_root('set', self.name, 'netns', namespace)
>  File "/usr/lib/python2.7/site-packages/quantum/agent/linux/ip_lib.py", line 158, in _as_root
>    kwargs.get('use_root_namespace', False))
>  File "/usr/lib/python2.7/site-packages/quantum/agent/linux/ip_lib.py", line 45, in _as_root
>    namespace)
>  File "/usr/lib/python2.7/site-packages/quantum/agent/linux/ip_lib.py", line 56, in _execute
>    root_helper=root_helper)
>  File "/usr/lib/python2.7/site-packages/quantum/agent/linux/utils.py", line 61, in execute
>    raise RuntimeError(m)
>RuntimeError: 
>Command: ['sudo', 'quantum-rootwrap', '/etc/quantum/rootwrap.conf', 'ip', 'link', 'set', 'qg-3851239a-5b', 'netns', 'qrouter-08ad50c6-4081-45f8-954d-b76595a8bcb9']
>Exit code: 2
>Stdout: ''
>Stderr: 'RTNETLINK answers: Invalid argument\n'

Actions: View

Attachments on bug 881741: 654708