Attachment 891532 Details for Bug 1093351 – metadata-agent.log

metadata-agent.log

metadata-agent.log (text/x-log), 11.08 KB, created by Ofer Blaut on 2014-05-01 13:51:16 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Ofer Blaut

Created: 2014-05-01 13:51:16 UTC

Size: 11.08 KB

patch

obsolete

>2014-05-01 11:16:50.272 24722 INFO neutron.common.config [-] Logging enabled!
>2014-05-01 11:16:50.411 24722 INFO eventlet.wsgi.server [req-065a687d-48c7-4eda-80e3-79df86311739 None] (24722) wsgi starting up on http:///:v/
>
>2014-05-01 11:16:50.415 24722 INFO neutron.openstack.common.rpc.common [req-065a687d-48c7-4eda-80e3-79df86311739 None] Connected to AMQP server on 10.35.160.121:5672
>2014-05-01 11:16:50.430 24722 INFO neutron.openstack.common.rpc.common [req-065a687d-48c7-4eda-80e3-79df86311739 None] Connected to AMQP server on 10.35.160.121:5672
>2014-05-01 11:17:50.488 24722 ERROR neutron.agent.metadata.agent [req-065a687d-48c7-4eda-80e3-79df86311739 None] Failed reporting state!
>2014-05-01 11:17:50.488 24722 TRACE neutron.agent.metadata.agent Traceback (most recent call last):
>2014-05-01 11:17:50.488 24722 TRACE neutron.agent.metadata.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/metadata/agent.py", line 302, in _report_state
>2014-05-01 11:17:50.488 24722 TRACE neutron.agent.metadata.agent     use_call=self.agent_state.get('start_flag'))
>2014-05-01 11:17:50.488 24722 TRACE neutron.agent.metadata.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/rpc.py", line 72, in report_state
>2014-05-01 11:17:50.488 24722 TRACE neutron.agent.metadata.agent     return self.call(context, msg, topic=self.topic)
>2014-05-01 11:17:50.488 24722 TRACE neutron.agent.metadata.agent   File "/usr/lib/python2.7/site-packages/neutron/openstack/common/rpc/proxy.py", line 129, in call
>2014-05-01 11:17:50.488 24722 TRACE neutron.agent.metadata.agent     exc.info, real_topic, msg.get('method'))
>2014-05-01 11:17:50.488 24722 TRACE neutron.agent.metadata.agent Timeout: Timeout while waiting on RPC response - topic: "q-plugin", RPC method: "report_state" info: "<unknown>"
>2014-05-01 11:17:50.488 24722 TRACE neutron.agent.metadata.agent 
>2014-05-01 11:17:50.490 24722 WARNING neutron.openstack.common.loopingcall [req-065a687d-48c7-4eda-80e3-79df86311739 None] task run outlasted interval by 30.203794 sec
>2014-05-01 11:34:29.671 1318 INFO neutron.common.config [-] Logging enabled!
>2014-05-01 11:34:32.306 1318 INFO eventlet.wsgi.server [req-677747b9-0c0f-4b03-9288-86a7eefb0713 None] (1318) wsgi starting up on http:///:v/
>
>2014-05-01 11:34:32.307 1318 ERROR neutron.openstack.common.rpc.common [req-677747b9-0c0f-4b03-9288-86a7eefb0713 None] AMQP server on 10.35.160.121:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
>2014-05-01 11:34:33.307 1318 INFO neutron.openstack.common.rpc.common [req-677747b9-0c0f-4b03-9288-86a7eefb0713 None] Reconnecting to AMQP server on 10.35.160.121:5672
>2014-05-01 11:34:33.317 1318 ERROR neutron.openstack.common.rpc.common [req-677747b9-0c0f-4b03-9288-86a7eefb0713 None] AMQP server on 10.35.160.121:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3 seconds.
>2014-05-01 11:34:36.319 1318 INFO neutron.openstack.common.rpc.common [req-677747b9-0c0f-4b03-9288-86a7eefb0713 None] Reconnecting to AMQP server on 10.35.160.121:5672
>2014-05-01 11:34:36.329 1318 ERROR neutron.openstack.common.rpc.common [req-677747b9-0c0f-4b03-9288-86a7eefb0713 None] AMQP server on 10.35.160.121:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 5 seconds.
>2014-05-01 11:34:41.330 1318 INFO neutron.openstack.common.rpc.common [req-677747b9-0c0f-4b03-9288-86a7eefb0713 None] Reconnecting to AMQP server on 10.35.160.121:5672
>2014-05-01 11:34:41.342 1318 INFO neutron.openstack.common.rpc.common [req-677747b9-0c0f-4b03-9288-86a7eefb0713 None] Connected to AMQP server on 10.35.160.121:5672
>2014-05-01 11:34:41.355 1318 INFO neutron.openstack.common.rpc.common [req-677747b9-0c0f-4b03-9288-86a7eefb0713 None] Connected to AMQP server on 10.35.160.121:5672
>2014-05-01 11:35:41.404 1318 ERROR neutron.agent.metadata.agent [req-677747b9-0c0f-4b03-9288-86a7eefb0713 None] Failed reporting state!
>2014-05-01 11:35:41.404 1318 TRACE neutron.agent.metadata.agent Traceback (most recent call last):
>2014-05-01 11:35:41.404 1318 TRACE neutron.agent.metadata.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/metadata/agent.py", line 302, in _report_state
>2014-05-01 11:35:41.404 1318 TRACE neutron.agent.metadata.agent     use_call=self.agent_state.get('start_flag'))
>2014-05-01 11:35:41.404 1318 TRACE neutron.agent.metadata.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/rpc.py", line 72, in report_state
>2014-05-01 11:35:41.404 1318 TRACE neutron.agent.metadata.agent     return self.call(context, msg, topic=self.topic)
>2014-05-01 11:35:41.404 1318 TRACE neutron.agent.metadata.agent   File "/usr/lib/python2.7/site-packages/neutron/openstack/common/rpc/proxy.py", line 129, in call
>2014-05-01 11:35:41.404 1318 TRACE neutron.agent.metadata.agent     exc.info, real_topic, msg.get('method'))
>2014-05-01 11:35:41.404 1318 TRACE neutron.agent.metadata.agent Timeout: Timeout while waiting on RPC response - topic: "q-plugin", RPC method: "report_state" info: "<unknown>"
>2014-05-01 11:35:41.404 1318 TRACE neutron.agent.metadata.agent 
>2014-05-01 11:35:41.429 1318 WARNING neutron.openstack.common.loopingcall [req-677747b9-0c0f-4b03-9288-86a7eefb0713 None] task run outlasted interval by 39.482961 sec
>2014-05-01 11:47:16.236 1318 WARNING neutron.openstack.common.loopingcall [req-677747b9-0c0f-4b03-9288-86a7eefb0713 None] task run outlasted interval by 308.797402 sec
>2014-05-01 11:49:48.172 1318 WARNING neutron.openstack.common.loopingcall [req-677747b9-0c0f-4b03-9288-86a7eefb0713 None] task run outlasted interval by 64.767517 sec
>2014-05-01 11:51:22.029 1318 WARNING neutron.openstack.common.loopingcall [req-677747b9-0c0f-4b03-9288-86a7eefb0713 None] task run outlasted interval by 3.527078 sec
>2014-05-01 11:56:53.033 1318 WARNING neutron.openstack.common.loopingcall [req-677747b9-0c0f-4b03-9288-86a7eefb0713 None] task run outlasted interval by 59.992639 sec
>2014-05-01 12:01:02.921 1318 WARNING neutron.openstack.common.loopingcall [req-677747b9-0c0f-4b03-9288-86a7eefb0713 None] task run outlasted interval by 9.299673 sec
>2014-05-01 12:04:54.222 1364 INFO neutron.common.config [-] Logging enabled!
>2014-05-01 12:04:57.381 1364 INFO eventlet.wsgi.server [req-9e82594d-1a1e-455c-9451-703f7cd46e5a None] (1364) wsgi starting up on http:///:v/
>
>2014-05-01 12:04:57.381 1364 ERROR neutron.openstack.common.rpc.common [req-9e82594d-1a1e-455c-9451-703f7cd46e5a None] AMQP server on 10.35.160.121:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
>2014-05-01 12:04:58.382 1364 INFO neutron.openstack.common.rpc.common [req-9e82594d-1a1e-455c-9451-703f7cd46e5a None] Reconnecting to AMQP server on 10.35.160.121:5672
>2014-05-01 12:04:58.391 1364 ERROR neutron.openstack.common.rpc.common [req-9e82594d-1a1e-455c-9451-703f7cd46e5a None] AMQP server on 10.35.160.121:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3 seconds.
>2014-05-01 12:05:01.393 1364 INFO neutron.openstack.common.rpc.common [req-9e82594d-1a1e-455c-9451-703f7cd46e5a None] Reconnecting to AMQP server on 10.35.160.121:5672
>2014-05-01 12:05:01.403 1364 ERROR neutron.openstack.common.rpc.common [req-9e82594d-1a1e-455c-9451-703f7cd46e5a None] AMQP server on 10.35.160.121:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 5 seconds.
>2014-05-01 12:05:06.406 1364 INFO neutron.openstack.common.rpc.common [req-9e82594d-1a1e-455c-9451-703f7cd46e5a None] Reconnecting to AMQP server on 10.35.160.121:5672
>2014-05-01 12:05:06.416 1364 ERROR neutron.openstack.common.rpc.common [req-9e82594d-1a1e-455c-9451-703f7cd46e5a None] AMQP server on 10.35.160.121:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 7 seconds.
>2014-05-01 12:05:13.418 1364 INFO neutron.openstack.common.rpc.common [req-9e82594d-1a1e-455c-9451-703f7cd46e5a None] Reconnecting to AMQP server on 10.35.160.121:5672
>2014-05-01 12:05:13.429 1364 INFO neutron.openstack.common.rpc.common [req-9e82594d-1a1e-455c-9451-703f7cd46e5a None] Connected to AMQP server on 10.35.160.121:5672
>2014-05-01 12:05:13.443 1364 INFO neutron.openstack.common.rpc.common [req-9e82594d-1a1e-455c-9451-703f7cd46e5a None] Connected to AMQP server on 10.35.160.121:5672
>2014-05-01 15:44:58.445 1405 INFO neutron.common.config [-] Logging enabled!
>2014-05-01 15:45:01.487 1405 INFO eventlet.wsgi.server [req-3a8aa097-c1bd-44b8-9b9c-b7a12f0657ce None] (1405) wsgi starting up on http:///:v/
>
>2014-05-01 15:45:01.488 1405 ERROR neutron.openstack.common.rpc.common [req-3a8aa097-c1bd-44b8-9b9c-b7a12f0657ce None] AMQP server on 10.35.160.121:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
>2014-05-01 15:45:02.488 1405 INFO neutron.openstack.common.rpc.common [req-3a8aa097-c1bd-44b8-9b9c-b7a12f0657ce None] Reconnecting to AMQP server on 10.35.160.121:5672
>2014-05-01 15:45:02.497 1405 ERROR neutron.openstack.common.rpc.common [req-3a8aa097-c1bd-44b8-9b9c-b7a12f0657ce None] AMQP server on 10.35.160.121:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3 seconds.
>2014-05-01 15:45:05.500 1405 INFO neutron.openstack.common.rpc.common [req-3a8aa097-c1bd-44b8-9b9c-b7a12f0657ce None] Reconnecting to AMQP server on 10.35.160.121:5672
>2014-05-01 15:45:05.513 1405 ERROR neutron.openstack.common.rpc.common [req-3a8aa097-c1bd-44b8-9b9c-b7a12f0657ce None] AMQP server on 10.35.160.121:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 5 seconds.
>2014-05-01 15:45:10.516 1405 INFO neutron.openstack.common.rpc.common [req-3a8aa097-c1bd-44b8-9b9c-b7a12f0657ce None] Reconnecting to AMQP server on 10.35.160.121:5672
>2014-05-01 15:45:10.528 1405 INFO neutron.openstack.common.rpc.common [req-3a8aa097-c1bd-44b8-9b9c-b7a12f0657ce None] Connected to AMQP server on 10.35.160.121:5672
>2014-05-01 15:45:10.543 1405 INFO neutron.openstack.common.rpc.common [req-3a8aa097-c1bd-44b8-9b9c-b7a12f0657ce None] Connected to AMQP server on 10.35.160.121:5672
>2014-05-01 15:46:10.598 1405 ERROR neutron.agent.metadata.agent [req-3a8aa097-c1bd-44b8-9b9c-b7a12f0657ce None] Failed reporting state!
>2014-05-01 15:46:10.598 1405 TRACE neutron.agent.metadata.agent Traceback (most recent call last):
>2014-05-01 15:46:10.598 1405 TRACE neutron.agent.metadata.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/metadata/agent.py", line 302, in _report_state
>2014-05-01 15:46:10.598 1405 TRACE neutron.agent.metadata.agent     use_call=self.agent_state.get('start_flag'))
>2014-05-01 15:46:10.598 1405 TRACE neutron.agent.metadata.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/rpc.py", line 72, in report_state
>2014-05-01 15:46:10.598 1405 TRACE neutron.agent.metadata.agent     return self.call(context, msg, topic=self.topic)
>2014-05-01 15:46:10.598 1405 TRACE neutron.agent.metadata.agent   File "/usr/lib/python2.7/site-packages/neutron/openstack/common/rpc/proxy.py", line 129, in call
>2014-05-01 15:46:10.598 1405 TRACE neutron.agent.metadata.agent     exc.info, real_topic, msg.get('method'))
>2014-05-01 15:46:10.598 1405 TRACE neutron.agent.metadata.agent Timeout: Timeout while waiting on RPC response - topic: "q-plugin", RPC method: "report_state" info: "<unknown>"
>2014-05-01 15:46:10.598 1405 TRACE neutron.agent.metadata.agent 
>2014-05-01 15:46:10.600 1405 WARNING neutron.openstack.common.loopingcall [req-3a8aa097-c1bd-44b8-9b9c-b7a12f0657ce None] task run outlasted interval by 39.773157 sec

Actions: View

Attachments on bug 1093351: 891532 | 891533