Bug 1958392

Summary: Overcloud deployment prepare failed for ipv6 job at resource creation failed for controller essage: Build of instance d8a0abe0-d3e6-4e9f-a4f4-e2b1f051c525 aborted: Failure prepping block device., Code: 500"
Product: Red Hat OpenStack Reporter: Paras Babbar <pbabbar>
Component: openstack-tripleoAssignee: Harald Jensås <hjensas>
Status: CLOSED NOTABUG QA Contact: Joe H. Rahme <jhakimra>
Severity: high Docs Contact:
Priority: high    
Version: 16.1 (Train)CC: hjensas, mburns, myadla, pweeks, ramishra, sbaker
Target Milestone: ---Keywords: Triaged
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-11-16 20:51:59 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1998448, 2002871, 2136787    
Bug Blocks:    

Description Paras Babbar 2021-05-07 19:48:52 UTC
Description of problem:

OSP16.1 deployment failed at prepare stage at the time of creating resource:

2021-05-03 18:24:59Z [overcloud.Compute.1.NovaCompute]: CREATE_IN_PROGRESS  state changed
2021-05-03 18:25:00Z [overcloud.Compute.0.NovaCompute]: CREATE_IN_PROGRESS  state changed
2021-05-03 18:25:15Z [overcloud.Controller.2.Controller]: CREATE_FAILED  ResourceInError: resources.Controller: Went to status ERROR due to "Message: Build of instance 09505b17-0e88-41e2-bbc3-a647067b8292 aborted: Failure prepping block device., Code: 500"
2021-05-03 18:25:15Z [overcloud.Controller.2.Controller]: DELETE_IN_PROGRESS  state changed
2021-05-03 18:25:19Z [overcloud.Controller.2.Controller]: DELETE_COMPLETE  state changed
2021-05-03 18:25:20Z [overcloud.Controller.1.Controller]: CREATE_FAILED  ResourceInError: resources.Controller: Went to status ERROR due to "Message: Build of instance d8a0abe0-d3e6-4e9f-a4f4-e2b1f051c525 aborted: Failure prepping block device., Code: 500"
2021-05-03 18:25:20Z [overcloud.Controller.1.Controller]: DELETE_IN_PROGRESS  state changed
2021-05-03 18:25:22Z [overcloud.Compute.1.NovaCompute]: CREATE_FAILED  ResourceInError: resources.NovaCompute: Went to status ERROR due to "Message: Build of instance 9571034a-004a-4442-84e0-a040cfdb65ad aborted: Failure prepping block device., Code: 500"
2021-05-03 18:25:22Z [overcloud.Compute.1.NovaCompute]: DELETE_IN_PROGRESS  state changed
2021-05-03 18:25:22Z [overcloud.Controller.0.Controller]: CREATE_FAILED  ResourceInError: resources.Controller: Went to status ERROR due to "Message: Build of instance e7f968ab-2026-4bba-8dfe-41512a8e9474 aborted: Failure prepping block device., Code: 500"
2021-05-03 18:25:22Z [overcloud.Controller.0.Controller]: DELETE_IN_PROGRESS  state changed
2021-05-03 18:25:22Z [overcloud.Compute.0.NovaCompute]: CREATE_FAILED  ResourceInError: resources.NovaCompute: Went to status ERROR due to "Message: Build of instance 36db9037-d990-4790-a0a5-c55208f9a638 aborted: Failure prepping block device., Code: 500"
2021-05-03 18:25:22Z [overcloud.Compute.0.NovaCompute]: DELETE_IN_PROGRESS  state changed
2021-05-03 18:25:23Z [overcloud.Controller.1.Controller]: DELETE_COMPLETE  state changed
2021-05-03 18:25:23Z [overcloud.Controller.2.Controller]: CREATE_IN_PROGRESS  state changed
2021-05-03 18:25:25Z [overcloud.Compute.1.NovaCompute]: DELETE_COMPLETE  state changed
2021-05-03 18:25:25Z [overcloud.Controller.0.Controller]: DELETE_COMPLETE  state changed
2021-05-03 18:25:25Z [overcloud.Compute.0.NovaCompute]: DELETE_COMPLETE  state changed
2021-05-03 18:25:26Z [overcloud.Controller.1.Controller]: CREATE_IN_PROGRESS  state changed
2021-05-03 18:25:28Z [overcloud.Controller.0.Controller]: CREATE_IN_PROGRESS  state changed
2021-05-03 18:25:37Z [overcloud.Controller.2.Controller]: CREATE_FAILED  ResourceInError: resources.Controller: Went to status ERROR due to "Message: Build of instance 96d1ba59-42d5-48f2-b049-088bb46c5f4c aborted: Failure prepping block device., Code: 500"
2021-05-03 18:25:37Z [overcloud.Controller.2.Controller]: DELETE_IN_PROGRESS  state changed
2021-05-03 18:25:41Z [overcloud.Controller.2.Controller]: DELETE_COMPLETE  state changed
2021-05-03 18:25:41Z [overcloud.Controller.1.Controller]: CREATE_FAILED  ResourceInError: resources.Controller: Went to status ERROR due to "Message: Build of instance ade91f8d-35bc-424c-9708-92fc8a9f2ffa aborted: Failure prepping block device., Code: 500"
2021-05-03 18:25:41Z [overcloud.Controller.1.Controller]: DELETE_IN_PROGRESS  state changed
2021-05-03 18:25:42Z [overcloud.Compute.0.NovaCompute]: CREATE_IN_PROGRESS  state changed
2021-05-03 18:25:43Z [overcloud.Compute.1.NovaCompute]: CREATE_IN_PROGRESS  state changed
2021-05-03 18:25:43Z [overcloud.Controller.0.Controller]: CREATE_FAILED  ResourceInError: resources.Controller: Went to status ERROR due to "Message: Build of instance f7ff34cc-7cc1-4f90-a4f2-ae1895384a46 aborted: Failure prepping block device., Code: 500"
2021-05-03 18:25:43Z [overcloud.Controller.0.Controller]: DELETE_IN_PROGRESS  state changed
2021-05-03 18:25:44Z [overcloud.Controller.1.Controller]: DELETE_COMPLETE  state changed
2021-05-03 18:25:46Z [overcloud.Controller.0.Controller]: DELETE_COMPLETE  state changed
2021-05-03 18:25:47Z [overcloud.Controller.2.Controller]: CREATE_IN_PROGRESS  state changed
2021-05-03 18:25:49Z [overcloud.Controller.1.Controller]: CREATE_IN_PROGRESS  state changed
2021-05-03 18:25:52Z [overcloud.Controller.0.Controller]: CREATE_IN_PROGRESS  state changed
2021-05-03 18:25:58Z [overcloud.Compute.0.NovaCompute]: CREATE_FAILED  ResourceInError: resources.NovaCompute: Went to status ERROR due to "Message: Build of instance 6e2e9517-58bb-40fe-8dd5-92df16b20e49 aborted: Failure prepping block device., Code: 500"
2021-05-03 18:25:58Z [overcloud.Compute.0.NovaCompute]: DELETE_IN_PROGRESS  state changed
2021-05-03 18:25:59Z [overcloud.Compute.1.NovaCompute]: CREATE_FAILED  ResourceInError: resources.NovaCompute: Went to status ERROR due to "Message: Build of instance 5b7777a3-ceb2-421d-b3d3-a005705eb008 aborted: Failure prepping block device., Code: 500"
2021-05-03 18:25:59Z [overcloud.Compute.1.NovaCompute]: DELETE_IN_PROGRESS  state changed
2021-05-03 18:26:02Z [overcloud.Compute.0.NovaCompute]: DELETE_COMPLETE  state changed
2021-05-03 18:26:04Z [overcloud.Compute.1.NovaCompute]: DELETE_COMPLETE  state changed
2021-05-03 18:26:06Z [overcloud.Controller.2.Controller]: CREATE_FAILED  ResourceInError: resources.Controller: Went to status ERROR due to "Message: Build of instance 2033a2dd-1cc4-4bbd-b799-60536bd58e6c aborted: Failure prepping block device., Code: 500"
2021-05-03 18:26:06Z [overcloud.Controller.2.Controller]: DELETE_IN_PROGRESS  state changed
2021-05-03 18:26:07Z [overcloud.Controller.1.Controller]: CREATE_FAILED  ResourceInError: resources.Controller: Went to status ERROR due to "Message: Build of instance bc638de0-2747-45c9-bc19-e9ff0f2c2207 aborted: Failure prepping block device., Code: 500"
2021-05-03 18:26:07Z [overcloud.Controller.1.Controller]: DELETE_IN_PROGRESS  state changed
2021-05-03 18:26:09Z [overcloud.Controller.2.Controller]: DELETE_COMPLETE  state changed
2021-05-03 18:26:09Z [overcloud.Controller.1.Controller]: DELETE_COMPLETE  state changed
2021-05-03 18:26:10Z [overcloud.Controller.0.Controller]: CREATE_FAILED  ResourceInError: resources.Controller: Went to status ERROR due to "Message: Build of instance 97241382-f871-4bdf-87cc-870579407fab aborted: Failure prepping block device., Code: 500"
2021-05-03 18:26:10Z [overcloud.Controller.0.Controller]: DELETE_IN_PROGRESS  state changed
2021-05-03 18:26:12Z [overcloud.Controller.0.Controller]: DELETE_COMPLETE  state changed
2021-05-03 18:26:18Z [overcloud.Controller.2.Controller]: CREATE_IN_PROGRESS  state changed
2021-05-03 18:26:19Z [overcloud.Controller.1.Controller]: CREATE_IN_PROGRESS  state changed
2021-05-03 18:26:21Z [overcloud.Controller.0.Controller]: CREATE_IN_PROGRESS  state changed
2021-05-03 18:26:30Z [overcloud.Controller.2.Controller]: CREATE_FAILED  ResourceInError: resources.Controller: Went to status ERROR due to "Message: Build of instance 621433c6-e9bb-4cff-b2c0-40a4b8cbb69c aborted: Failure prepping block device., Code: 500"
2021-05-03 18:26:31Z [overcloud.Controller.2.Controller]: DELETE_IN_PROGRESS  state changed
2021-05-03 18:26:33Z [overcloud.Controller.1.Controller]: CREATE_FAILED  ResourceInError: resources.Controller: Went to status ERROR due to "Message: Build of instance fe61bbca-d5ff-4301-a4f1-810173a53346 aborted: Failure prepping block device., Code: 500"
2021-05-03 18:26:33Z [overcloud.Controller.1.Controller]: DELETE_IN_PROGRESS  state changed
2021-05-03 18:26:33Z [overcloud.Controller.2.Controller]: DELETE_COMPLETE  state changed
2021-05-03 18:26:35Z [overcloud.Controller.0.Controller]: CREATE_FAILED  ResourceInError: resources.Controller: Went to status ERROR due to "Message: Build of instance ae3ec96b-f566-4eb7-b224-7b8f0a0461e2 aborted: Failure prepping block device., Code: 500"
2021-05-03 18:26:35Z [overcloud.Controller.0.Controller]: DELETE_IN_PROGRESS  state changed
2021-05-03 18:26:35Z [overcloud.Controller.1.Controller]: DELETE_COMPLETE  state changed
2021-05-03 18:26:35Z [overcloud.Compute.0.NovaCompute]: CREATE_IN_PROGRESS  state changed
2021-05-03 18:26:38Z [overcloud.Compute.1.NovaCompute]: CREATE_IN_PROGRESS  state changed
2021-05-03 18:26:38Z [overcloud.Controller.0.Controller]: DELETE_COMPLETE  state changed
2021-05-03 18:26:47Z [overcloud.Compute.0.NovaCompute]: CREATE_FAILED  ResourceInError: resources.NovaCompute: Went to status ERROR due to "Message: Build of instance 0d48eb98-74e9-4d13-9f2c-82f79f870f13 aborted: Failure prepping block device., Code: 500"
2021-05-03 18:26:47Z [overcloud.Compute.0]: CREATE_FAILED  Resource CREATE failed: ResourceInError: resources.NovaCompute: Went to status ERROR due to "Message: Build of instance 1300f6f2-ec83-49b6-91b6-4eceffa8b1e7 aborted: Failure prepping block device., Code: 500"
2021-05-03 18:26:48Z [overcloud.Compute.0]: CREATE_FAILED  ResourceInError: resources[0].resources.NovaCompute: Went to status ERROR due to "Message: Build of instance 1300f6f2-ec83-49b6-91b6-4eceffa8b1e7 aborted: Failure prepping block device., Code: 500"
2021-05-03 18:26:48Z [overcloud.Compute]: UPDATE_FAILED  Resource CREATE failed: ResourceInError: resources[0].resources.NovaCompute: Went to status ERROR due to "Message: Build of instance 1300f6f2-ec83-49b6-91b6-4eceffa8b1e7 aborted: Failure prepping block device., Code: 500"
2021-05-03 18:26:48Z [overcloud.Compute]: CREATE_FAILED  resources.Compute: Resource CREATE failed: ResourceInError: resources[0].resources.NovaCompute: Went to status ERROR due to "Message: Build of instance 1300f6f2-ec83-49b6-91b6-4eceffa8b1e7 aborted: Failure prepping block device., Code: 500"
2021-05-03 18:26:49Z [overcloud]: CREATE_FAILED  Resource CREATE failed: resources.Compute: Resource CREATE failed: ResourceInError: resources[0].resources.NovaCompute: Went to status ERROR due to "Message: Build of instance 1300f6f2-ec83-49b6-91b6-4eceffa8b1e7 aborted: Failure prepping block device., C
2021-05-03 18:26:50Z [overcloud.Compute.1.NovaCompute]: CREATE_FAILED  ResourceInError: resources.NovaCompute: Went to status ERROR due to "Message: Build of instance 51ee6468-2d32-4f9b-af2a-1799ee910376 aborted: Failure prepping block device., Code: 500"
2021-05-03 18:26:50Z [overcloud.Compute.1]: CREATE_FAILED  Resource CREATE failed: ResourceInError: resources.NovaCompute: Went to status ERROR due to "Message: Build of instance 90e9aed1-472a-4cda-bc3f-c4a5d3e014be aborted: Failure prepping block device., Code: 500"
2021-05-03 18:26:50Z [overcloud.Compute.1]: CREATE_FAILED  ResourceInError: resources[1].resources.NovaCompute: Went to status ERROR due to "Message: Build of instance 90e9aed1-472a-4cda-bc3f-c4a5d3e014be aborted: Failure prepping block device., Code: 500"
2021-05-03 18:26:50Z [overcloud.Compute]: UPDATE_FAILED  Resource CREATE failed: ResourceInError: resources[1].resources.NovaCompute: Went to status ERROR due to "Message: Build of instance 90e9aed1-472a-4cda-bc3f-c4a5d3e014be aborted: Failure prepping block device., Code: 500"
2021-05-03 18:26:50Z [overcloud.Controller.2.Controller]: CREATE_IN_PROGRESS  state changedHeat Stack create failed.
Heat Stack create failed.

2021-05-03 18:26:52Z [overcloud.Controller.1.Controller]: CREATE_IN_PROGRESS  state changed
2021-05-03 18:26:56Z [overcloud.Controller.0.Controller]: CREATE_IN_PROGRESS  state changed
2021-05-03 18:27:04Z [overcloud.Controller.2.Controller]: CREATE_FAILED  ResourceInError: resources.Controller: Went to status ERROR due to "Message: Build of instance bdc4e4f3-a94d-4765-b1a5-d8a4a1c07666 aborted: Failure prepping block device., Code: 500"
2021-05-03 18:27:04Z [overcloud.Controller.2.Controller]: DELETE_IN_PROGRESS  state changed
2021-05-03 18:27:06Z [overcloud.Controller.1.Controller]: CREATE_FAILED  ResourceInError: resources.Controller: Went to status ERROR due to "Message: Build of instance 4e58b12a-8dae-4f14-b2a7-33944e4dc699 aborted: Failure prepping block device., Code: 500"
2021-05-03 18:27:06Z [overcloud.Controller.1.Controller]: DELETE_IN_PROGRESS  state changed
2021-05-03 18:27:07Z [overcloud.Controller.2.Controller]: DELETE_COMPLETE  state changed
2021-05-03 18:27:08Z [overcloud.Controller.1.Controller]: DELETE_COMPLETE  state changed
2021-05-03 18:27:09Z [overcloud.Controller.0.Controller]: CREATE_FAILED  ResourceInError: resources.Controller: Went to status ERROR due to "Message: Build of instance 0911b5fe-8266-462d-bd34-b15639f3b785 aborted: Failure prepping block device., Code: 500"
2021-05-03 18:27:09Z [overcloud.Controller.0.Controller]: DELETE_IN_PROGRESS  state changed
2021-05-03 18:27:11Z [overcloud.Controller.0.Controller]: DELETE_COMPLETE  state changed

 Stack overcloud/dcd31987-c701-42e9-8528-b743c46032dc CREATE_FAILED 

overcloud.Compute.1.NovaCompute:
  resource_type: OS::TripleO::ComputeServer
  physical_resource_id: 51ee6468-2d32-4f9b-af2a-1799ee910376
  status: CREATE_FAILED
  status_reason: |
    ResourceInError: resources.NovaCompute: Went to status ERROR due to "Message: Build of instance 51ee6468-2d32-4f9b-af2a-1799ee910376 aborted: Failure prepping block device., Code: 500"
overcloud.Compute.0.NovaCompute:
  resource_type: OS::TripleO::ComputeServer
  physical_resource_id: 0d48eb98-74e9-4d13-9f2c-82f79f870f13
  status: CREATE_FAILED
  status_reason: |
    ResourceInError: resources.NovaCompute: Went to status ERROR due to "Message: Build of instance 0d48eb98-74e9-4d13-9f2c-82f79f870f13 aborted: Failure prepping block device., Code: 500"

Version-Release number of selected component (if applicable):


How reproducible:
everytime
Steps to Reproduce:
1.Deploy OSP16.1 ipv6 job
2. Failed OC deployment


Actual results:
OSP16.1  OC failed

Expected results:

OSP16.1 OC deployment failed
Additional info:

Comment 3 Rabi Mishra 2021-05-10 16:31:38 UTC
*** Bug 1959023 has been marked as a duplicate of this bug. ***

Comment 8 Steve Baker 2021-11-16 20:51:59 UTC
When the dnsmasq fix is available, the IPv6 job can switch back to using UEFI boot.