Attachment 1479396 Details for Bug 1623347 – nova-compute.log

nova-compute.log

nova-compute.log (text/plain), 9.70 KB, created by mxie@redhat.com on 2018-08-29 07:31:20 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: mxie@redhat.com

Created: 2018-08-29 07:31:20 UTC

Size: 9.70 KB

patch

obsolete

>2018-08-29 02:29:06.573 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88] Traceback (most recent call last):
>2018-08-29 02:29:06.573 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1579, in _prep_block_device
>2018-08-29 02:29:06.573 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]     wait_func=self._await_block_device_map_created)
>2018-08-29 02:29:06.573 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 837, in attach_block_devices
>2018-08-29 02:29:06.573 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]     _log_and_attach(device)
>2018-08-29 02:29:06.573 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 834, in _log_and_attach
>2018-08-29 02:29:06.573 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]     bdm.attach(*attach_args, **attach_kwargs)
>2018-08-29 02:29:06.573 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 722, in attach
>2018-08-29 02:29:06.573 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]     self._call_wait_func(context, wait_func, volume_api, vol['id'])
>2018-08-29 02:29:06.573 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 679, in _call_wait_func
>2018-08-29 02:29:06.573 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]     {'volume_id': volume_id, 'exc': exc})
>2018-08-29 02:29:06.573 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
>2018-08-29 02:29:06.573 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]     self.force_reraise()
>2018-08-29 02:29:06.573 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
>2018-08-29 02:29:06.573 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]     six.reraise(self.type_, self.value, self.tb)
>2018-08-29 02:29:06.573 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 669, in _call_wait_func
>2018-08-29 02:29:06.573 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]     wait_func(context, volume_id)
>2018-08-29 02:29:06.573 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1252, in _await_block_device_map_created
>2018-08-29 02:29:06.573 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]     volume_status=volume_status)
>2018-08-29 02:29:06.573 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88] VolumeNotCreated: Volume 50380aac-4033-4193-a03b-83e5dd51f763 did not finish being created even after we waited 190 seconds or 61 attempts. And its status is downloading.
>2018-08-29 02:29:06.573 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88] 
>2018-08-29 02:29:12.013 39853 ERROR nova.compute.manager [req-ebbdeaec-412a-414b-b613-adf93029afe9 d47eaf2e31ed4e208d42b4a03877024c 9b6db83d89a14dd393a48461aa88debe - default default] [instance: ad703618-6c71-429b-a47d-b3492a766f88] Build of instance ad703618-6c71-429b-a47d-b3492a766f88 aborted: Volume 50380aac-4033-4193-a03b-83e5dd51f763 did not finish being created even after we waited 190 seconds or 61 attempts. And its status is downloading.: BuildAbortException: Build of instance ad703618-6c71-429b-a47d-b3492a766f88 aborted: Volume 50380aac-4033-4193-a03b-83e5dd51f763 did not finish being created even after we waited 190 seconds or 61 attempts. And its status is downloading.
>2018-08-29 02:29:12.013 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88] Traceback (most recent call last):
>2018-08-29 02:29:12.013 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1840, in _do_build_and_run_instance
>2018-08-29 02:29:12.013 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]     filter_properties, request_spec)
>2018-08-29 02:29:12.013 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2062, in _build_and_run_instance
>2018-08-29 02:29:12.013 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]     bdms=block_device_mapping)
>2018-08-29 02:29:12.013 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
>2018-08-29 02:29:12.013 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]     self.force_reraise()
>2018-08-29 02:29:12.013 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
>2018-08-29 02:29:12.013 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]     six.reraise(self.type_, self.value, self.tb)
>2018-08-29 02:29:12.013 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2014, in _build_and_run_instance
>2018-08-29 02:29:12.013 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]     block_device_mapping) as resources:
>2018-08-29 02:29:12.013 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]   File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__
>2018-08-29 02:29:12.013 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]     return self.gen.next()
>2018-08-29 02:29:12.013 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2221, in _build_resources
>2018-08-29 02:29:12.013 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88]     reason=e.format_message())
>2018-08-29 02:29:12.013 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88] BuildAbortException: Build of instance ad703618-6c71-429b-a47d-b3492a766f88 aborted: Volume 50380aac-4033-4193-a03b-83e5dd51f763 did not finish being created even after we waited 190 seconds or 61 attempts. And its status is downloading.
>2018-08-29 02:29:12.013 39853 ERROR nova.compute.manager [instance: ad703618-6c71-429b-a47d-b3492a766f88] 
>2018-08-29 02:29:13.500 39853 INFO nova.compute.manager [req-ebbdeaec-412a-414b-b613-adf93029afe9 d47eaf2e31ed4e208d42b4a03877024c 9b6db83d89a14dd393a48461aa88debe - default default] [instance: ad703618-6c71-429b-a47d-b3492a766f88] Took 1.49 seconds to deallocate network for instance.
>2018-08-29 02:29:17.070 39853 INFO nova.scheduler.client.report [req-ebbdeaec-412a-414b-b613-adf93029afe9 d47eaf2e31ed4e208d42b4a03877024c 9b6db83d89a14dd393a48461aa88debe - default default] Deleted allocation for instance ad703618-6c71-429b-a47d-b3492a766f88
>2018-08-29 02:29:17.071 39853 WARNING nova.compute.manager [req-ebbdeaec-412a-414b-b613-adf93029afe9 d47eaf2e31ed4e208d42b4a03877024c 9b6db83d89a14dd393a48461aa88debe - default default] 3 consecutive build failures
>2018-08-29 02:29:49.415 39853 INFO nova.compute.resource_tracker [req-ebbdeaec-412a-414b-b613-adf93029afe9 d47eaf2e31ed4e208d42b4a03877024c 9b6db83d89a14dd393a48461aa88debe - default default] Final resource view: name=dell-per730-65.lab.eng.pek2.redhat.com phys_ram=65442MB used_ram=3584MB phys_disk=199GB used_disk=28GB total_vcpus=40 used_vcpus=12 pci_stats=[]
>2018-08-29 02:30:33.913 39853 INFO nova.compute.resource_tracker [req-ebbdeaec-412a-414b-b613-adf93029afe9 d47eaf2e31ed4e208d42b4a03877024c 9b6db83d89a14dd393a48461aa88debe - default default] Final resource view: name=dell-per730-65.lab.eng.pek2.redhat.com phys_ram=65442MB used_ram=3584MB phys_disk=199GB used_disk=28GB total_vcpus=40 used_vcpus=12 pci_stats=[]
>2018-08-29 02:31:36.321 39853 INFO nova.compute.resource_tracker [req-ebbdeaec-412a-414b-b613-adf93029afe9 d47eaf2e31ed4e208d42b4a03877024c 9b6db83d89a14dd393a48461aa88debe - default default] Final resource view: name=dell-per730-65.lab.eng.pek2.redhat.com phys_ram=65442MB used_ram=3584MB phys_disk=199GB used_disk=28GB total_vcpus=40 used_vcpus=12 pci_stats=[]
>2018-08-29 02:32:36.690 39853 INFO nova.compute.resource_tracker [req-ebbdeaec-412a-414b-b613-adf93029afe9 d47eaf2e31ed4e208d42b4a03877024c 9b6db83d89a14dd393a48461aa88debe - default default] Final resource view: name=dell-per730-65.lab.eng.pek2.redhat.com phys_ram=65442MB used_ram=3584MB phys_disk=199GB used_disk=28GB total_vcpus=40 used_vcpus=12 pci_stats=[]
>2018-08-29 02:33:38.727 39853 INFO nova.compute.resource_tracker [req-ebbdeaec-412a-414b-b613-adf93029afe9 d47eaf2e31ed4e208d42b4a03877024c 9b6db83d89a14dd393a48461aa88debe - default default] Final resource view: name=dell-per730-65.lab.eng.pek2.redhat.com phys_ram=65442MB used_ram=3584MB phys_disk=199GB used_disk=28GB total_vcpus=40 used_vcpus=12 pci_stats=[]
>

Actions: View

Attachments on bug 1623347: 1479396