Bug 1619704
| Summary: | Failing to deploy BM UC timeout waiting for execution | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Product: | Red Hat OpenStack | Reporter: | Tzach Shefi <tshefi> | ||||||
| Component: | python-tripleoclient | Assignee: | Emilien Macchi <emacchi> | ||||||
| Status: | CLOSED ERRATA | QA Contact: | Arik Chernetsky <achernet> | ||||||
| Severity: | medium | Docs Contact: | |||||||
| Priority: | medium | ||||||||
| Version: | 13.0 (Queens) | CC: | bcrochet, brad, emacchi, hbrock, jschluet, jslagle, linh.vu, mariel, mburns, rbrady | ||||||
| Target Milestone: | --- | Keywords: | Triaged, ZStream | ||||||
| Target Release: | 13.0 (Queens) | ||||||||
| Hardware: | Unspecified | ||||||||
| OS: | Unspecified | ||||||||
| Whiteboard: | |||||||||
| Fixed In Version: | python-tripleoclient-9.2.6-5.el7ost | Doc Type: | If docs needed, set a value | ||||||
| Doc Text: | Story Points: | --- | |||||||
| Clone Of: | Environment: | ||||||||
| Last Closed: | 2019-01-16 17:55:03 UTC | Type: | Bug | ||||||
| Regression: | --- | Mount Type: | --- | ||||||
| Documentation: | --- | CRM: | |||||||
| Verified Versions: | Category: | --- | |||||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||||
| Embargoed: | |||||||||
| Attachments: |
|
||||||||
|
Description
Tzach Shefi
2018-08-21 14:17:53 UTC
Created attachment 1477568 [details]
sosrepot
Is there some context as to why this is a HardwareProvisioning issue? Hello Bob, Sorry, my fault - reallocating to Workflows as it's apparently a timeout in Mistral. FYI, suspect timeout was indeed the source of problem. On same host bumped up to 20 min, rebooted host. Managed to complete undercloud deploy this time around: 2018-08-27 16:39:05,421 INFO: ############################################################################# Undercloud install complete. The file containing this installation's passwords is at /home/stack/undercloud-passwords.conf. There is also a stackrc file at /home/stack/stackrc. These files are needed to interact with the OpenStack services, and should be secured. ############################################################################# All that remain to verify is check that 20 min code update lands in RPM. FYI I'd reinstalled same system, bumped to 600 still hit timeout. Bumped to figure up to 700 plus restarted hosts before it managed to complete UC deployment. Not sure what did it the extra +100 or host reboot. Don't use my system as a reference as it's geriatric HW, least 5Y old :) upstream patch not backported to stable/queens, moving back to ASSIGNED (In reply to Tzach Shefi from comment #6) > FYI, suspect timeout was indeed the source of problem. > On same host bumped up to 20 min, rebooted host. > Managed to complete undercloud deploy this time around: > > 2018-08-27 16:39:05,421 INFO: > ############################################################################# > Undercloud install complete. > > The file containing this installation's passwords is at > /home/stack/undercloud-passwords.conf. > > There is also a stackrc file at /home/stack/stackrc. > > These files are needed to interact with the OpenStack services, and should be > secured. > > ############################################################################# > > All that remain to verify is check that 20 min code update lands in RPM. Hi Tzach, I hit this exact issue. Please let me know how I can modify the timeout to 20 mins since I'm new to openstack. Thanks, Linh 2018-11-05 17:22:44,451 INFO: Created flavor "ceph-storage" with profile "ceph-storage"
2018-11-05 17:22:44,500 INFO: Created flavor "block-storage" with profile "block-storage"
2018-11-05 17:22:44,551 INFO: Created flavor "swift-storage" with profile "swift-storage"
2018-11-05 17:22:44,552 INFO: Configuring Mistral workbooks
2018-11-05 17:22:58,774 INFO: Mistral workbooks configured successfully
2018-11-05 17:29:01,368 ERROR: TIMEOUT waiting for execution 8eead3f0-2bf8-45c4-aac9-4f75ff81b462 to finish. State: RUNNING
2018-11-05 17:29:01,368 DEBUG: An exception occurred
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 2337, in install
_post_config(instack_env, upgrade)
File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 2029, in _post_config
_post_config_mistral(instack_env, mistral, swift)
File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 1965, in _post_config_mistral
_create_default_plan(mistral, plans)
File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 1907, in _create_default_plan
fail_on_error=True)
File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 1852, in _wait_for_mistral_execution
raise RuntimeError(error_message)
RuntimeError: TIMEOUT waiting for execution 8eead3f0-2bf8-45c4-aac9-4f75ff81b462 to finish. State: RUNNING
2018-11-05 17:29:01,368 ERROR:
#############################################################################
Undercloud install failed.
Reason: TIMEOUT waiting for execution 8eead3f0-2bf8-45c4-aac9-4f75ff81b462 to finish. State: RUNNING
See the previous output for details about what went wrong. The full install
log can be found at /home/stack/.instack/install-undercloud.log.
#############################################################################
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 2337, in install
_post_config(instack_env, upgrade)
File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 2029, in _post_config
_post_config_mistral(instack_env, mistral, swift)
File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 1965, in _post_config_mistral
_create_default_plan(mistral, plans)
File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 1907, in _create_default_plan
fail_on_error=True)
File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 1852, in _wait_for_mistral_execution
raise RuntimeError(error_message)
RuntimeError: TIMEOUT waiting for execution 8eead3f0-2bf8-45c4-aac9-4f75ff81b462 to finish. State: RUNNING
Command 'instack-install-undercloud' returned non-zero exit status 1
[stack@undercloud-director ~]$
I increased the timeout, but now having a different error.
2018-11-06 00:48:05,280 INFO: Configuring Mistral workbooks
2018-11-06 00:48:19,476 INFO: Mistral workbooks configured successfully
2018-11-06 01:02:54,085 ERROR: ERROR error creating the default Deployment Plan overcloud Check the create_default_deployment_plan execution in Mistral with openstack workflow execution list Mistral execution ID: 63224e63-d0fc-4793-a1d6-be39a6c31c6b
2018-11-06 01:02:54,085 DEBUG: An exception occurred
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 2337, in install
_post_config(instack_env, upgrade)
File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 2029, in _post_config
_post_config_mistral(instack_env, mistral, swift)
File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 1965, in _post_config_mistral
_create_default_plan(mistral, plans)
File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 1907, in _create_default_plan
fail_on_error=True)
File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 1844, in _wait_for_mistral_execution
raise RuntimeError(error_message)
RuntimeError: ERROR error creating the default Deployment Plan overcloud Check the create_default_deployment_plan execution in Mistral with openstack workflow execution list Mistral execution ID: 63224e63-d0fc-4793-a1d6-be39a6c31c6b
2018-11-06 01:02:54,086 ERROR:
#############################################################################
Undercloud install failed.
Reason: ERROR error creating the default Deployment Plan overcloud Check the create_default_deployment_plan execution in Mistral with openstack workflow execution list Mistral execution ID: 63224e63-d0fc-4793-a1d6-be39a6c31c6b
See the previous output for details about what went wrong. The full install
log can be found at /home/stack/.instack/install-undercloud.log.
#############################################################################
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 2337, in install
_post_config(instack_env, upgrade)
File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 2029, in _post_config
_post_config_mistral(instack_env, mistral, swift)
File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 1965, in _post_config_mistral
_create_default_plan(mistral, plans)
File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 1907, in _create_default_plan
fail_on_error=True)
File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 1844, in _wait_for_mistral_execution
raise RuntimeError(error_message)
RuntimeError: ERROR error creating the default Deployment Plan overcloud Check the create_default_deployment_plan execution in Mistral with openstack workflow execution list Mistral execution ID: 63224e63-d0fc-4793-a1d6-be39a6c31c6b
Command 'instack-install-undercloud' returned non-zero exit status 1
[stack@undercloud-director ~]$
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2019:0068 |