1280398 – VMs will not launch

Bug 1280398 - VMs will not launch

Summary: VMs will not launch

Keywords:
Status:	CLOSED NOTABUG
Alias:	None
Product:	Red Hat OpenStack
Classification:	Red Hat
Component:	openstack-nova
Sub Component:
Version:	7.0 (Kilo)
Hardware:	Unspecified
OS:	Unspecified
Priority:	high
Severity:	high
Target Milestone:	---
Target Release:	---
Assignee:	Eoghan Glynn
QA Contact:	nlevinki
Docs Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+	depends on / blocked

Reported:	2015-11-11 16:29 UTC by Jeremy
Modified:	2019-09-09 14:17 UTC (History)
CC List:	11 users (show)
Fixed In Version:
Doc Type:	Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed:	2015-11-11 21:14:57 UTC
Target Upstream Version:
Embargoed:

Attachments	(Terms of Use)

Description Jeremy 2015-11-11 16:29:31 UTC

Description of problem:
Newly built site.  Launch all VMs fail with the following error message:
Build of instance bb20a1e0-0403-4106-a2c7-bc8d21df4fac aborted: Failure prepping block device.

Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:
/var/log/nova/nova-compute.log

32136: ERROR nova.compute.manager [-] [instance: cd7f2c47-d9e9-4ee7-a0f5-a776682c85ee] Build of instance cd7f2c47-d9e9-4ee7-a0f5-a776682c85ee aborted: Failure prepping block device.
32136: TRACE nova.compute.manager [instance: cd7f2c47-d9e9-4ee7-a0f5-a776682c85ee] Traceback (most recent call last):
32136: TRACE nova.compute.manager [instance: cd7f2c47-d9e9-4ee7-a0f5-a776682c85ee]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2075, in _do_build_and_run_instance
32136: TRACE nova.compute.manager [instance: cd7f2c47-d9e9-4ee7-a0f5-a776682c85ee]     filter_properties)
32136: TRACE nova.compute.manager [instance: cd7f2c47-d9e9-4ee7-a0f5-a776682c85ee]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2174, in _build_and_run_instance
32136: TRACE nova.compute.manager [instance: cd7f2c47-d9e9-4ee7-a0f5-a776682c85ee]     'create.error', fault=e)
32136: TRACE nova.compute.manager [instance: cd7f2c47-d9e9-4ee7-a0f5-a776682c85ee]   File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 82, in __exit__
32136: TRACE nova.compute.manager [instance: cd7f2c47-d9e9-4ee7-a0f5-a776682c85ee]     six.reraise(self.type_, self.value, self.tb)
32136: TRACE nova.compute.manager [instance: cd7f2c47-d9e9-4ee7-a0f5-a776682c85ee]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2147, in _build_and_run_instance
32136: TRACE nova.compute.manager [instance: cd7f2c47-d9e9-4ee7-a0f5-a776682c85ee]     block_device_mapping) as resources:
32136: TRACE nova.compute.manager [instance: cd7f2c47-d9e9-4ee7-a0f5-a776682c85ee]   File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__
32136: TRACE nova.compute.manager [instance: cd7f2c47-d9e9-4ee7-a0f5-a776682c85ee]     return self.gen.next()
32136: TRACE nova.compute.manager [instance: cd7f2c47-d9e9-4ee7-a0f5-a776682c85ee]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2285, in _build_resources
32136: TRACE nova.compute.manager [instance: cd7f2c47-d9e9-4ee7-a0f5-a776682c85ee]     reason=msg)
32136: TRACE nova.compute.manager [instance: cd7f2c47-d9e9-4ee7-a0f5-a776682c85ee] BuildAbortException: Build of instance cd7f2c47-d9e9-4ee7-a0f5-a776682c85ee aborted: Failure prepping block device.
32136: TRACE nova.compute.manager [instance: cd7f2c47-d9e9-4ee7-a0f5-a776682c85ee]
32136: WARNING nova.compute.manager [-] While synchronizing instance power states, found 4 instances in the database and 0 instances on the hypervisor.
32136: WARNING nova.compute.manager [-] While synchronizing instance power states, found 4 instances in the database and 0 instances on the hypervisor.
32136: WARNING nova.compute.manager [-] While synchronizing instance power states, found 4 instances in the database and 0 instances on the hypervisor.
32136: WARNING nova.compute.manager [-] While synchronizing instance power states, found 4 instances in the database and 0 instances on the hypervisor.


32136: WARNING nova.compute.manager [-] While synchronizing instance power states, found 4 instances in the database and 0 instances on the hypervisor.
32136: ERROR nova.compute.manager [-] [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac] Instance failed block device setup
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac] Traceback (most recent call last):
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1864, in _prep_block_device
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]     do_check_attach=do_check_attach) +
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 407, in attach_block_devices
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]     map(_log_and_attach, block_device_mapping)
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 405, in _log_and_attach
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]     bdm.attach(*attach_args, **attach_kwargs)
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]   File "/usr/lib/python2.7/site-packages/nova/virt/block_device.py", line 331, in attach
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]     '', '', image_id=self.image_id)
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]   File "/usr/lib/python2.7/site-packages/nova/volume/cinder.py", line 387, in create
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]     item = cinderclient(context).volumes.create(size, **kwargs)
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]   File "/usr/lib/python2.7/site-packages/cinderclient/v1/volumes.py", line 187, in create
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]     return self._create('/volumes', body, 'volume')
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]   File "/usr/lib/python2.7/site-packages/cinderclient/base.py", line 157, in _create
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]     resp, body = self.api.client.post(url, body=body)
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]   File "/usr/lib/python2.7/site-packages/cinderclient/client.py", line 305, in post
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]     return self._cs_request(url, 'POST', **kwargs)
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]   File "/usr/lib/python2.7/site-packages/cinderclient/client.py", line 269, in _cs_request
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]     **kwargs)
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]   File "/usr/lib/python2.7/site-packages/cinderclient/client.py", line 252, in request
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]     raise exceptions.from_response(resp, body)
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac] ClientException: The server has either erred or is incapable of performing the requested operation. (HTTP 500)


32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]
32136: ERROR nova.compute.manager [-] [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac] Failure prepping block device
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac] Traceback (most recent call last):
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2263, in _build_resources
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]     block_device_mapping)
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1892, in _prep_block_device
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]     raise exception.InvalidBDM()
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac] InvalidBDM: Block Device Mapping is Invalid.
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]
32136: ERROR nova.compute.manager [-] [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac] Build of instance bb20a1e0-0403-4106-a2c7-bc8d21df4fac aborted: Failure prepping block device.
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac] Traceback (most recent call last):
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2075, in _do_build_and_run_instance
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]     filter_properties)
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2174, in _build_and_run_instance
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]     'create.error', fault=e)
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]   File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 82, in __exit__
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]     six.reraise(self.type_, self.value, self.tb)
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2147, in _build_and_run_instance
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]     block_device_mapping) as resources:
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]   File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]     return self.gen.next()
32136: TRACE nova.compute.manager [instance: bb20a1e0-0403-4106-a2c7-bc8d21df4fac]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2285, in _build_resources

Note You need to log in before you can comment on or make changes to this bug.