Attachment 872580 Details for Bug 1042801 – cinder migrate error log

cinder migrate error log

cinder-migrate-error-log.noDEBUG (text/plain), 12.87 KB, created by Deepak C Shetty on 2014-03-10 07:36:41 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Deepak C Shetty

Created: 2014-03-10 07:36:41 UTC

Size: 12.87 KB

patch

obsolete

>2014-03-10 06:41:55.150 INFO cinder.volume.flows.manager.create_volume [req-f158ec34-63d8-47b2-b3e4-8702ed115536 849ead280ea342ac811f9aa1b47ac28c 1ca85ebcc7a94cc39a210dcd42c35cee] Volume bcd183c1-19f8-4fd1-819b-1e6d52114826: being created using CreateVolumeFromSpecTask._create_raw_volume with specification: {'status': u'creating', 'volume_size': 1, 'volume_name': u'volume-bcd183c1-19f8-4fd1-819b-1e6d52114826'}
>2014-03-10 06:41:55.372 INFO cinder.volume.drivers.glusterfs [req-f158ec34-63d8-47b2-b3e4-8702ed115536 849ead280ea342ac811f9aa1b47ac28c 1ca85ebcc7a94cc39a210dcd42c35cee] casted to devstack-vm.localdomain:/gvol1
>2014-03-10 06:41:55.816 INFO cinder.volume.flows.manager.create_volume [req-f158ec34-63d8-47b2-b3e4-8702ed115536 849ead280ea342ac811f9aa1b47ac28c 1ca85ebcc7a94cc39a210dcd42c35cee] Volume volume-bcd183c1-19f8-4fd1-819b-1e6d52114826 (bcd183c1-19f8-4fd1-819b-1e6d52114826): created successfully
>2014-03-10 06:42:03.310 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 06:42:06.392 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 06:43:03.314 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 06:43:06.401 INFO cinder.volume.manager [-] Updating volume status
>==================================================================
>2014-03-10 06:43:47.675 INFO cinder.volume.flows.manager.create_volume [req-93a8a641-0c19-47ba-b621-6f2bfdd34a59 849ead280ea342ac811f9aa1b47ac28c 1ca85ebcc7a94cc39a210dcd42c35cee] Volume 4357653f-9b84-42d1-96cb-66c5b31c313f: being created using CreateVolumeFromSpecTask._create_raw_volume with specification: {'status': u'creating', 'volume_size': 1, 'volume_name': u'volume-4357653f-9b84-42d1-96cb-66c5b31c313f'}
>2014-03-10 06:43:47.909 INFO cinder.volume.drivers.glusterfs [req-93a8a641-0c19-47ba-b621-6f2bfdd34a59 849ead280ea342ac811f9aa1b47ac28c 1ca85ebcc7a94cc39a210dcd42c35cee] casted to devstack-vm.localdomain:/gvol2
>2014-03-10 06:43:48.245 INFO cinder.volume.flows.manager.create_volume [req-93a8a641-0c19-47ba-b621-6f2bfdd34a59 849ead280ea342ac811f9aa1b47ac28c 1ca85ebcc7a94cc39a210dcd42c35cee] Volume volume-4357653f-9b84-42d1-96cb-66c5b31c313f (4357653f-9b84-42d1-96cb-66c5b31c313f): created successfully
>2014-03-10 06:43:49.083 INFO cinder.openstack.common.rpc.common [req-93a8a641-0c19-47ba-b621-6f2bfdd34a59 849ead280ea342ac811f9aa1b47ac28c 1ca85ebcc7a94cc39a210dcd42c35cee] Connected to AMQP server on localhost:5672
>2014-03-10 06:43:49.089 ERROR cinder.openstack.common.rpc.amqp [req-93a8a641-0c19-47ba-b621-6f2bfdd34a59 849ead280ea342ac811f9aa1b47ac28c 1ca85ebcc7a94cc39a210dcd42c35cee] Exception during message handling
>2014-03-10 06:43:49.089 TRACE cinder.openstack.common.rpc.amqp Traceback (most recent call last):
>2014-03-10 06:43:49.089 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/openstack/common/rpc/amqp.py", line 462, in _process_data
>2014-03-10 06:43:49.089 TRACE cinder.openstack.common.rpc.amqp     **args)
>2014-03-10 06:43:49.089 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/openstack/common/rpc/dispatcher.py", line 176, in dispatch
>2014-03-10 06:43:49.089 TRACE cinder.openstack.common.rpc.amqp     raise AttributeError("No such RPC function '%s'" % method)
>2014-03-10 06:43:49.089 TRACE cinder.openstack.common.rpc.amqp AttributeError: No such RPC function 'create_export'
>2014-03-10 06:43:49.089 TRACE cinder.openstack.common.rpc.amqp
>2014-03-10 06:43:49.092 ERROR cinder.openstack.common.rpc.common [req-93a8a641-0c19-47ba-b621-6f2bfdd34a59 849ead280ea342ac811f9aa1b47ac28c 1ca85ebcc7a94cc39a210dcd42c35cee] Returning exception No such RPC function 'create_export' to caller
>2014-03-10 06:43:49.092 ERROR cinder.openstack.common.rpc.common [req-93a8a641-0c19-47ba-b621-6f2bfdd34a59 849ead280ea342ac811f9aa1b47ac28c 1ca85ebcc7a94cc39a210dcd42c35cee] ['Traceback (most recent call last):\n', '  File "/opt/stack/cinder/cinder/openstack/common/rpc/amqp.py", line 462, in _process_data\n    **args)\n', '  File "/opt/stack/cinder/cinder/openstack/common/rpc/dispatcher.py", line 176, in dispatch\n    raise AttributeError("No such RPC function \'%s\'" % method)\n', "AttributeError: No such RPC function 'create_export'\n"]
>2014-03-10 06:43:49.095 ERROR cinder.volume.driver [req-93a8a641-0c19-47ba-b621-6f2bfdd34a59 849ead280ea342ac811f9aa1b47ac28c 1ca85ebcc7a94cc39a210dcd42c35cee] Failed to attach volume 4357653f-9b84-42d1-96cb-66c5b31c313f
>2014-03-10 06:43:49.118 ERROR cinder.volume.manager [req-93a8a641-0c19-47ba-b621-6f2bfdd34a59 849ead280ea342ac811f9aa1b47ac28c 1ca85ebcc7a94cc39a210dcd42c35cee] Failed to copy volume bcd183c1-19f8-4fd1-819b-1e6d52114826 to 4357653f-9b84-42d1-96cb-66c5b31c313f
>2014-03-10 06:43:49.169 INFO cinder.volume.manager [req-93a8a641-0c19-47ba-b621-6f2bfdd34a59 849ead280ea342ac811f9aa1b47ac28c 1ca85ebcc7a94cc39a210dcd42c35cee] volume 4357653f-9b84-42d1-96cb-66c5b31c313f: deleting
>2014-03-10 06:43:49.360 ERROR cinder.openstack.common.rpc.amqp [req-93a8a641-0c19-47ba-b621-6f2bfdd34a59 849ead280ea342ac811f9aa1b47ac28c 1ca85ebcc7a94cc39a210dcd42c35cee] Exception during message handling
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp Traceback (most recent call last):
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/openstack/common/rpc/amqp.py", line 462, in _process_data
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp     **args)
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/openstack/common/rpc/dispatcher.py", line 172, in dispatch
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp     result = getattr(proxyobj, method)(ctxt, **kwargs)
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/volume/manager.py", line 1052, in migrate_volume
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp     self.db.volume_update(ctxt, volume_ref['id'], updates)
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/openstack/common/excutils.py", line 68, in __exit__
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp     six.reraise(self.type_, self.value, self.tb)
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/volume/manager.py", line 1043, in migrate_volume
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp     new_type_id)
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/volume/manager.py", line 928, in _migrate_volume_generic
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp     new_volume['migration_status'] = None
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/openstack/common/excutils.py", line 68, in __exit__
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp     six.reraise(self.type_, self.value, self.tb)
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/volume/manager.py", line 908, in _migrate_volume_generic
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp     remote='dest')
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/volume/driver.py", line 304, in copy_volume_data
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp     {'status': dest_orig_status})
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/openstack/common/excutils.py", line 68, in __exit__
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp     six.reraise(self.type_, self.value, self.tb)
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/volume/driver.py", line 298, in copy_volume_data
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp     remote=dest_remote)
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/volume/driver.py", line 382, in _attach_volume
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp     rpcapi.create_export(context, volume)
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/volume/rpcapi.py", line 208, in create_export
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp     version='1.13')
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/openstack/common/rpc/proxy.py", line 125, in call
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp     result = rpc.call(context, real_topic, msg, timeout)
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/openstack/common/rpc/__init__.py", line 137, in call
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp     return _get_impl().call(CONF, context, topic, msg, timeout)
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/openstack/common/rpc/impl_kombu.py", line 815, in call
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp     rpc_amqp.get_connection_pool(conf, Connection))
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/openstack/common/rpc/amqp.py", line 575, in call
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp     rv = list(rv)
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/openstack/common/rpc/amqp.py", line 540, in __iter__
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp     raise result
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp AttributeError: No such RPC function 'create_export'
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp Traceback (most recent call last):
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/openstack/common/rpc/amqp.py", line 462, in _process_data
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp     **args)
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp   File "/opt/stack/cinder/cinder/openstack/common/rpc/dispatcher.py", line 176, in dispatch
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp     raise AttributeError("No such RPC function '%s'" % method)
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp AttributeError: No such RPC function 'create_export'
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp
>2014-03-10 06:43:49.360 TRACE cinder.openstack.common.rpc.amqp
>2014-03-10 06:44:03.318 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 06:44:06.400 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 06:45:03.323 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 06:45:06.408 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 06:46:03.326 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 06:46:06.416 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 06:47:03.332 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 06:47:06.417 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 06:48:03.333 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 06:48:06.426 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 06:49:03.342 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 06:49:06.425 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 06:50:03.344 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 06:50:06.435 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 06:51:03.349 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 06:51:06.441 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 06:52:03.356 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 06:52:06.453 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 06:53:03.362 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 07:06:00.080 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 07:06:00.244 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 07:06:00.507 WARNING cinder.openstack.common.loopingcall [-] task run outlasted interval by 657.149423 sec
>2014-03-10 07:06:00.513 WARNING cinder.openstack.common.loopingcall [-] task run outlasted interval by 714.060431 sec
>2014-03-10 07:06:00.520 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 07:06:00.521 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 07:07:00.518 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 07:07:00.524 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 07:08:00.525 INFO cinder.volume.manager [-] Updating volume status
>2014-03-10 07:08:00.529 INFO cinder.volume.manager [-] Updating volume status

Actions: View

Attachments on bug 1042801: 872580