Description: In overcloud deployment using ephermal heat, "openstack overcloud delete" is failing trying to reach heat endpoints "keystoneauth1.exceptions.catalog.EndpointNotFound: public endpoint for orchestration service in regionOne region not found" Deployment command have "--heat-type pod":- ~~~ openstack overcloud deploy --stack overcloud . . --heat-type pod ~~~ (undercloud) [zuul@undercloud ~]$ openstack overcloud status +------------+-------------------+ | Stack Name | Deployment Status | +------------+-------------------+ | overcloud | DEPLOY_SUCCESS | +------------+-------------------+ (undercloud)$ openstack overcloud delete overcloud Are you sure you want to delete this overcloud [y/N]? y PLAY [delete ipa entries for overcloud nodes] ********************************** 2021-09-03 11:21:07.487990 | 00bbaf30-a9c1-1e79-313f-000000000009 | TASK | Check if undercloud is an ipa client 2021-09-03 11:21:07.968360 | 00bbaf30-a9c1-1e79-313f-000000000009 | OK | Check if undercloud is an ipa client | localhost 2021-09-03 11:21:07.971382 | 00bbaf30-a9c1-1e79-313f-000000000009 | TIMING | Check if undercloud is an ipa client | localhost | 0:00:00.576511 | 0.48s PLAY [Overcloud Delete] ******************************************************** 2021-09-03 11:21:08.003214 | 00bbaf30-a9c1-1e79-313f-000000000015 | TASK | Check for required inputs 2021-09-03 11:21:08.053392 | 00bbaf30-a9c1-1e79-313f-000000000015 | SKIPPED | Check for required inputs | localhost | item=stack_name 2021-09-03 11:21:08.056359 | 00bbaf30-a9c1-1e79-313f-000000000015 | TIMING | Check for required inputs | localhost | 0:00:00.661491 | 0.05s 2021-09-03 11:21:08.063108 | 00bbaf30-a9c1-1e79-313f-000000000019 | TASK | Delete service vips used 2021-09-03 11:21:11.749546 | 00bbaf30-a9c1-1e79-313f-000000000019 | CHANGED | Delete service vips used | localhost 2021-09-03 11:21:11.752009 | 00bbaf30-a9c1-1e79-313f-000000000019 | TIMING | Delete service vips used | localhost | 0:00:04.357139 | 3.69s 2021-09-03 11:21:11.757666 | 00bbaf30-a9c1-1e79-313f-00000000001a | TASK | Delete OVN MAC Address ports 2021-09-03 11:21:18.648231 | 00bbaf30-a9c1-1e79-313f-00000000001a | CHANGED | Delete OVN MAC Address ports | localhost 2021-09-03 11:21:18.650832 | 00bbaf30-a9c1-1e79-313f-00000000001a | TIMING | Delete OVN MAC Address ports | localhost | 0:00:11.255963 | 6.89s 2021-09-03 11:21:18.657659 | 00bbaf30-a9c1-1e79-313f-00000000001b | TASK | Delete heat stack 2021-09-03 11:21:21.405423 | 00bbaf30-a9c1-1e79-313f-00000000001b | RETRY | Delete heat stack | localhost | 16 retries left 2021-09-03 11:21:27.864145 | 00bbaf30-a9c1-1e79-313f-00000000001b | RETRY | Delete heat stack | localhost | 15 retries left 2021-09-03 11:21:34.318704 | 00bbaf30-a9c1-1e79-313f-00000000001b | RETRY | Delete heat stack | localhost | 14 retries left 2021-09-03 11:21:40.779585 | 00bbaf30-a9c1-1e79-313f-00000000001b | RETRY | Delete heat stack | localhost | 13 retries left 2021-09-03 11:21:47.379331 | 00bbaf30-a9c1-1e79-313f-00000000001b | RETRY | Delete heat stack | localhost | 12 retries left 2021-09-03 11:21:53.905110 | 00bbaf30-a9c1-1e79-313f-00000000001b | RETRY | Delete heat stack | localhost | 11 retries left 2021-09-03 11:22:00.370962 | 00bbaf30-a9c1-1e79-313f-00000000001b | RETRY | Delete heat stack | localhost | 10 retries left 2021-09-03 11:22:06.837081 | 00bbaf30-a9c1-1e79-313f-00000000001b | RETRY | Delete heat stack | localhost | 9 retries left 2021-09-03 11:22:13.374924 | 00bbaf30-a9c1-1e79-313f-00000000001b | RETRY | Delete heat stack | localhost | 8 retries left 2021-09-03 11:22:19.879400 | 00bbaf30-a9c1-1e79-313f-00000000001b | RETRY | Delete heat stack | localhost | 7 retries left 2021-09-03 11:22:26.341948 | 00bbaf30-a9c1-1e79-313f-00000000001b | RETRY | Delete heat stack | localhost | 6 retries left 2021-09-03 11:22:32.811051 | 00bbaf30-a9c1-1e79-313f-00000000001b | RETRY | Delete heat stack | localhost | 5 retries left 2021-09-03 11:22:39.271946 | 00bbaf30-a9c1-1e79-313f-00000000001b | RETRY | Delete heat stack | localhost | 4 retries left 2021-09-03 11:22:45.814329 | 00bbaf30-a9c1-1e79-313f-00000000001b | RETRY | Delete heat stack | localhost | 3 retries left 2021-09-03 11:22:52.268368 | 00bbaf30-a9c1-1e79-313f-00000000001b | RETRY | Delete heat stack | localhost | 2 retries left 2021-09-03 11:22:58.738500 | 00bbaf30-a9c1-1e79-313f-00000000001b | RETRY | Delete heat stack | localhost | 1 retries left An exception occurred during task execution. To see the full traceback, use -vvv. The error was: keystoneauth1.exceptions.catalog.EndpointNotFound: public endpoint for orchestration service in regionOne region not found 2021-09-03 11:23:05.192214 | 00bbaf30-a9c1-1e79-313f-00000000001b | FATAL | Delete heat stack | localhost | error={"attempts": 16, "changed": false, "module_stderr": "Traceback (most recent call last):\n File \"<stdin>\", line 102, in <module>\n File \"<stdin>\", line 94, in _ansiballz_main\n File \"<stdin>\", line 40, in invoke_module\n File \"/usr/lib64/python3.6/runpy.py\", line 205, in run_module\n return _run_module_code(code, init_globals, run_name, mod_spec)\n File \"/usr/lib64/python3.6/runpy.py\", line 96, in _run_module_code\n mod_name, mod_spec, pkg_name, script_name)\n File \"/usr/lib64/python3.6/runpy.py\", line 85, in _run_code\n exec(code, run_globals)\n File \"/tmp/ansible_openstack.cloud.stack_payload_ihm2pl6p/ansible_openstack.cloud.stack_payload.zip/ansible_collections/openstack/cloud/plugins/modules/stack.py\", line 248, in <module>\n File \"/tmp/ansible_openstack.cloud.stack_payload_ihm2pl6p/ansible_openstack.cloud.stack_payload.zip/ansible_collections/openstack/cloud/plugins/modules/stack.py\", line 244, in main\n File \"/tmp/ansible_openstack.cloud.stack_payload_ihm2pl6p/ansible_openstack.cloud.stack_payload.zip/ansible_collections/openstack/cloud/plugins/module_utils/openstack.py\", line 406, in __call__\n File \"/tmp/ansible_openstack.cloud.stack_payload_ihm2pl6p/ansible_openstack.cloud.stack_payload.zip/ansible_collections/openstack/cloud/plugins/modules/stack.py\", line 218, in run\n File \"/usr/lib/python3.6/site-packages/openstack/cloud/_orchestration.py\", line 255, in get_stack\n self, _search_one_stack, name_or_id, filters)\n File \"/usr/lib/python3.6/site-packages/openstack/cloud/_utils.py\", line 197, in _get_entity\n entities = search(name_or_id, filters, **kwargs)\n File \"/usr/lib/python3.6/site-packages/openstack/cloud/_orchestration.py\", line 243, in _search_one_stack\n stack = self.orchestration.find_stack(\n File \"/usr/lib/python3.6/site-packages/openstack/service_description.py\", line 87, in __get__\n proxy = self._make_proxy(instance)\n File \"/usr/lib/python3.6/site-packages/openstack/service_description.py\", line 262, in _make_proxy\n found_version = temp_adapter.get_api_major_version()\n File \"/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py\", line 354, in get_api_major_version\n return self.session.get_api_major_version(auth or self.auth, **kwargs)\n File \"/usr/lib/python3.6/site-packages/keystoneauth1/session.py\", line 1276, in get_api_major_version\n return auth.get_api_major_version(self, **kwargs)\n File \"/usr/lib/python3.6/site-packages/keystoneauth1/identity/base.py\", line 500, in get_api_major_version\n data = get_endpoint_data(discover_versions=discover_versions)\n File \"/usr/lib/python3.6/site-packages/keystoneauth1/identity/base.py\", line 279, in get_endpoint_data\n service_name=service_name)\n File \"/usr/lib/python3.6/site-packages/keystoneauth1/access/service_catalog.py\", line 462, in endpoint_data_for\n raise exceptions.EndpointNotFound(msg)\nkeystoneauth1.exceptions.catalog.EndpointNotFound: public endpoint for orchestration service in regionOne region not found\n", "module_stdout": "", "msg": "MODULE FAILURE\nSee stdout/stderr for the exact error", "rc": 1} 2021-09-03 11:23:05.193567 | 00bbaf30-a9c1-1e79-313f-00000000001b | TIMING | Delete heat stack | localhost | 0:01:57.798699 | 106.53s NO MORE HOSTS LEFT ************************************************************* PLAY RECAP ********************************************************************* localhost : ok=3 changed=2 unreachable=0 failed=1 skipped=1 rescued=0 ignored=0 2021-09-03 11:23:05.200132 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Summary Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-09-03 11:23:05.200963 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Total Tasks: 5 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-09-03 11:23:05.201810 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Elapsed Time: 0:01:57.806958 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-09-03 11:23:05.202671 | UUID | Info | Host | Task Name | Run Time 2021-09-03 11:23:05.203564 | 00bbaf30-a9c1-1e79-313f-00000000001b | SUMMARY | localhost | Delete heat stack | 106.53s 2021-09-03 11:23:05.204413 | 00bbaf30-a9c1-1e79-313f-00000000001a | SUMMARY | localhost | Delete OVN MAC Address ports | 6.89s 2021-09-03 11:23:05.205287 | 00bbaf30-a9c1-1e79-313f-000000000019 | SUMMARY | localhost | Delete service vips used | 3.69s 2021-09-03 11:23:05.206151 | 00bbaf30-a9c1-1e79-313f-000000000009 | SUMMARY | localhost | Check if undercloud is an ipa client | 0.48s 2021-09-03 11:23:05.207019 | 00bbaf30-a9c1-1e79-313f-000000000015 | SUMMARY | localhost | Check for required inputs | 0.05s 2021-09-03 11:23:05.207922 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ End Summary Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-09-03 11:23:05.208777 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ State Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2021-09-03 11:23:05.209651 | ~~~~~~~~~~~~~~~~~~ Number of nodes which did not deploy successfully: 1 ~~~~~~~~~~~~~~~~~ 2021-09-03 11:23:05.210585 | The following node(s) had failures: localhost Version-Release number of selected component (if applicable): RHOSP17 Steps to Reproduce: 1. Deploy overcloud with " --heat-type pod" 2. Try to delete overcloud with "openstack overcloud delete overcloud" Actual results: Overcloud delete failing because it's trying to delete heat stack, With ephermal heat we don't have running heat service on undercloud anymore and no endpoints are available. Expected results: "openstack overcloud delete" should complete successfully, and not try to delete heat stack as it doesn't exist.
https://bugs.launchpad.net/tripleo/+bug/1938618
Deleting overcloud is successful: openstack overcloud delete overcloud /usr/lib/python3.9/site-packages/ansible/_vendor/__init__.py:42: UserWarning: One or more Python packages bundled by this ansible-core distribution were already loaded (pyparsing). This may result in undefined behavior. warnings.warn('One or more Python packages bundled by this ansible-core distribution were already ' Are you sure you want to delete this overcloud [y/N]? y [DEPRECATION WARNING]: ANSIBLE_CALLBACK_WHITELIST option, normalizing names to new standard, use ANSIBLE_CALLBACKS_ENABLED instead. This feature will be removed from ansible-core in version 2.15. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. PLAY [delete ipa entries for overcloud nodes] ********************************** 2022-06-17 17:07:07.578157 | 525400d4-bbaf-3a01-0bc0-00000000000e | TASK | Check if undercloud is an ipa client 2022-06-17 17:07:07.919345 | 525400d4-bbaf-3a01-0bc0-00000000000e | OK | Check if undercloud is an ipa client | localhost 2022-06-17 17:07:07.920491 | 525400d4-bbaf-3a01-0bc0-00000000000e | TIMING | Check if undercloud is an ipa client | localhost | 0:00:00.380662 | 0.34s 2022-06-17 17:07:07.925309 | 525400d4-bbaf-3a01-0bc0-00000000000f | TASK | End play if undercloud is not an ipa client PLAY [Overcloud Delete] ******************************************************** 2022-06-17 17:07:07.943701 | 525400d4-bbaf-3a01-0bc0-00000000001a | TASK | Check for required inputs 2022-06-17 17:07:07.973987 | 525400d4-bbaf-3a01-0bc0-00000000001a | SKIPPED | Check for required inputs | localhost | item=stack_name 2022-06-17 17:07:07.979636 | 525400d4-bbaf-3a01-0bc0-00000000001a | TIMING | Check for required inputs | localhost | 0:00:00.439837 | 0.03s 2022-06-17 17:07:07.984189 | 525400d4-bbaf-3a01-0bc0-00000000001b | TASK | Set overcloud_deploy_path 2022-06-17 17:07:08.019795 | 525400d4-bbaf-3a01-0bc0-00000000001b | OK | Set overcloud_deploy_path | localhost 2022-06-17 17:07:08.020799 | 525400d4-bbaf-3a01-0bc0-00000000001b | TIMING | Set overcloud_deploy_path | localhost | 0:00:00.480968 | 0.04s 2022-06-17 17:07:08.024854 | 525400d4-bbaf-3a01-0bc0-00000000001c | TASK | Set config_download_path 2022-06-17 17:07:08.060753 | 525400d4-bbaf-3a01-0bc0-00000000001c | OK | Set config_download_path | localhost 2022-06-17 17:07:08.061836 | 525400d4-bbaf-3a01-0bc0-00000000001c | TIMING | Set config_download_path | localhost | 0:00:00.522041 | 0.04s 2022-06-17 17:07:08.069037 | 525400d4-bbaf-3a01-0bc0-000000000020 | TASK | Delete service vips used 2022-06-17 17:07:10.660849 | 525400d4-bbaf-3a01-0bc0-000000000020 | CHANGED | Delete service vips used | localhost 2022-06-17 17:07:10.662280 | 525400d4-bbaf-3a01-0bc0-000000000020 | TIMING | Delete service vips used | localhost | 0:00:03.122475 | 2.59s 2022-06-17 17:07:10.667065 | 525400d4-bbaf-3a01-0bc0-000000000021 | TASK | Delete OVN MAC Address ports 2022-06-17 17:07:13.945013 | 525400d4-bbaf-3a01-0bc0-000000000021 | CHANGED | Delete OVN MAC Address ports | localhost 2022-06-17 17:07:13.946305 | 525400d4-bbaf-3a01-0bc0-000000000021 | TIMING | Delete OVN MAC Address ports | localhost | 0:00:06.406505 | 3.28s 2022-06-17 17:07:13.951374 | 525400d4-bbaf-3a01-0bc0-000000000022 | TASK | Delete heat stack 2022-06-17 17:07:13.977653 | 525400d4-bbaf-3a01-0bc0-000000000022 | SKIPPED | Delete heat stack | localhost 2022-06-17 17:07:13.978796 | 525400d4-bbaf-3a01-0bc0-000000000022 | TIMING | Delete heat stack | localhost | 0:00:06.438944 | 0.03s 2022-06-17 17:07:13.983262 | 525400d4-bbaf-3a01-0bc0-000000000023 | TASK | Remove the config download stack 2022-06-17 17:07:14.418808 | 525400d4-bbaf-3a01-0bc0-000000000023 | CHANGED | Remove the config download stack | localhost 2022-06-17 17:07:14.420997 | 525400d4-bbaf-3a01-0bc0-000000000023 | TIMING | Remove the config download stack | localhost | 0:00:06.881196 | 0.44s 2022-06-17 17:07:14.426062 | 525400d4-bbaf-3a01-0bc0-000000000024 | TASK | Remove the deploy stack 2022-06-17 17:07:14.811821 | 525400d4-bbaf-3a01-0bc0-000000000024 | CHANGED | Remove the deploy stack | localhost 2022-06-17 17:07:14.815044 | 525400d4-bbaf-3a01-0bc0-000000000024 | TIMING | Remove the deploy stack | localhost | 0:00:07.275246 | 0.39s 2022-06-17 17:07:14.822940 | 525400d4-bbaf-3a01-0bc0-000000000025 | TASK | Delete overcloud network Virtual IPs 2022-06-17 17:07:19.228737 | 525400d4-bbaf-3a01-0bc0-000000000025 | OK | Delete overcloud network Virtual IPs | localhost 2022-06-17 17:07:19.230057 | 525400d4-bbaf-3a01-0bc0-000000000025 | TIMING | Delete overcloud network Virtual IPs | localhost | 0:00:11.690249 | 4.41s 2022-06-17 17:07:19.238649 | 525400d4-bbaf-3a01-0bc0-00000000001e | TASK | Workflow notice 2022-06-17 17:07:19.275377 | 525400d4-bbaf-3a01-0bc0-00000000001e | OK | Workflow notice | localhost | result={ "changed": false, "msg": "Ansible workflow completed." } 2022-06-17 17:07:19.276331 | 525400d4-bbaf-3a01-0bc0-00000000001e | TIMING | Workflow notice | localhost | 0:00:11.736535 | 0.04s PLAY RECAP ********************************************************************* localhost : ok=9 changed=4 unreachable=0 failed=0 skipped=2 rescued=0 ignored=0 2022-06-17 17:07:19.283598 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Summary Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2022-06-17 17:07:19.284044 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Total Tasks: 11 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2022-06-17 17:07:19.284561 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Elapsed Time: 0:00:11.744773 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2022-06-17 17:07:19.285293 | UUID | Info | Host | Task Name | Run Time 2022-06-17 17:07:19.285945 | 525400d4-bbaf-3a01-0bc0-000000000025 | SUMMARY | localhost | Delete overcloud network Virtual IPs | 4.41s 2022-06-17 17:07:19.286572 | 525400d4-bbaf-3a01-0bc0-000000000021 | SUMMARY | localhost | Delete OVN MAC Address ports | 3.28s 2022-06-17 17:07:19.287178 | 525400d4-bbaf-3a01-0bc0-000000000020 | SUMMARY | localhost | Delete service vips used | 2.59s 2022-06-17 17:07:19.287782 | 525400d4-bbaf-3a01-0bc0-000000000023 | SUMMARY | localhost | Remove the config download stack | 0.44s 2022-06-17 17:07:19.288366 | 525400d4-bbaf-3a01-0bc0-000000000024 | SUMMARY | localhost | Remove the deploy stack | 0.39s 2022-06-17 17:07:19.288928 | 525400d4-bbaf-3a01-0bc0-00000000000e | SUMMARY | localhost | Check if undercloud is an ipa client | 0.34s 2022-06-17 17:07:19.289612 | 525400d4-bbaf-3a01-0bc0-00000000001e | SUMMARY | localhost | Workflow notice | 0.04s 2022-06-17 17:07:19.290194 | 525400d4-bbaf-3a01-0bc0-00000000001c | SUMMARY | localhost | Set config_download_path | 0.04s 2022-06-17 17:07:19.290777 | 525400d4-bbaf-3a01-0bc0-00000000001b | SUMMARY | localhost | Set overcloud_deploy_path | 0.04s 2022-06-17 17:07:19.291296 | 525400d4-bbaf-3a01-0bc0-00000000001a | SUMMARY | localhost | Check for required inputs | 0.03s 2022-06-17 17:07:19.291948 | 525400d4-bbaf-3a01-0bc0-000000000022 | SUMMARY | localhost | Delete heat stack | 0.03s 2022-06-17 17:07:19.292522 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ End Summary Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Success. [stack@undercloud-0 ~]$
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (Release of components for Red Hat OpenStack Platform 17.0 (Wallaby)), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHEA-2022:6543