Bug 1487239

Summary: [UPDATES] Failed to delete oc: resources.AllNodesDeploySteps.resources.WorkflowTasks_Step2: Not Found
Product: Red Hat OpenStack Reporter: Yurii Prokulevych <yprokule>
Component: openstack-heatAssignee: Rabi Mishra <ramishra>
Status: CLOSED ERRATA QA Contact: Ronnie Rasouli <rrasouli>
Severity: medium Docs Contact:
Priority: medium    
Version: 12.0 (Pike)CC: lbezdick, mburns, ramishra, rhel-osp-director-maint, sbaker, shardy, srevivo, therve, tvignaud, zbitter
Target Milestone: gaKeywords: Triaged
Target Release: 12.0 (Pike)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: openstack-heat-9.0.1-0.20171023060845.be1e2e9.el7ost Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2017-12-13 22:02:49 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Yurii Prokulevych 2017-08-31 13:33:22 UTC 
Description of problem:
-----------------------
After updating uc from 2017-08-18.3 to 2017-08-28.10 and attempt to setup heat's output failed to delete oc.
openstack stack delete --wait overcloud
Are you sure you want to delete this stack(s) [y/N]? y
2017-08-31 08:19:08Z [overcloud]: DELETE_IN_PROGRESS  Stack DELETE started
2017-08-31 08:19:24Z [overcloud.EndpointMapData]: DELETE_IN_PROGRESS  state changed
2017-08-31 08:19:24Z [overcloud.BlockStorageSshKnownHostsDeployment]: DELETE_IN_PROGRESS  state changed
2017-08-31 08:19:24Z [overcloud.ComputeSshKnownHostsDeployment]: DELETE_IN_PROGRESS  state changed
2017-08-31 08:19:24Z [overcloud.ObjectStorageSshKnownHostsDeployment]: DELETE_IN_PROGRESS  state changed
2017-08-31 08:19:24Z [overcloud.CephStorageSshKnownHostsDeployment]: DELETE_IN_PROGRESS  state changed
2017-08-31 08:19:24Z [overcloud.DeployedServerEnvironment]: DELETE_IN_PROGRESS  state changed
2017-08-31 08:19:24Z [overcloud.ControllerSshKnownHostsDeployment]: DELETE_IN_PROGRESS  state changed
2017-08-31 08:19:24Z [overcloud.ServerIdMap]: DELETE_IN_PROGRESS  state changed
2017-08-31 08:19:25Z [overcloud.AllNodesDeploySteps]: DELETE_IN_PROGRESS  state changed
2017-08-31 08:19:25Z [overcloud.BlockStorageSshKnownHostsDeployment]: DELETE_COMPLETE  state changed
2017-08-31 08:19:25Z [overcloud.ObjectStorageSshKnownHostsDeployment]: DELETE_COMPLETE  state changed
2017-08-31 08:19:25Z [overcloud.CephStorageSshKnownHostsDeployment]: DELETE_COMPLETE  state changed
2017-08-31 08:19:25Z [overcloud.DeployedServerEnvironment]: DELETE_COMPLETE  state changed
2017-08-31 08:19:25Z [overcloud.EndpointMapData]: DELETE_COMPLETE  state changed
2017-08-31 08:19:25Z [overcloud.ServerIdMap]: DELETE_COMPLETE  state changed
2017-08-31 08:19:25Z [overcloud.ServerOsCollectConfigData]: DELETE_IN_PROGRESS  state changed
2017-08-31 08:19:26Z [overcloud.ServerOsCollectConfigData]: DELETE_COMPLETE  state changed
2017-08-31 08:19:27Z [overcloud.ComputeSshKnownHostsDeployment]: DELETE_COMPLETE  state changed
2017-08-31 08:19:29Z [overcloud.ControllerSshKnownHostsDeployment]: DELETE_COMPLETE  state changed
2017-08-31 08:19:29Z [overcloud.SshKnownHostsConfig]: DELETE_IN_PROGRESS  state changed
2017-08-31 08:19:31Z [overcloud.SshKnownHostsConfig]: DELETE_COMPLETE  state changed
2017-08-31 08:19:59Z [overcloud.AllNodesDeploySteps]: DELETE_FAILED  NotFound: resources.AllNodesDeploySteps.resources.WorkflowTasks_Step2: Not Found (HTTP 404)
2017-08-31 08:19:59Z [overcloud]: DELETE_FAILED  Resource DELETE failed: NotFound: resources.AllNodesDeploySteps.resources.WorkflowTasks_Step2: Not Found (HTTP 404)

 Stack overcloud DELETE_FAILED 

Unable to delete 1 of the 1 stacks.

Version-Release number of selected component (if applicable):
-------------------------------------------------------------
python-heatclient-1.11.0-0.20170814165725.804ab3e.el7ost.noarch
openstack-heat-common-9.0.0-0.20170821132121.22d7142.el7ost.noarch
openstack-heat-api-9.0.0-0.20170821132121.22d7142.el7ost.noarch
heat-cfntools-1.3.0-2.el7ost.noarch
openstack-heat-api-cfn-9.0.0-0.20170821132121.22d7142.el7ost.noarch
python-heat-agent-1.4.1-0.20170821130002.ff31eb2.el7ost.noarch
openstack-tripleo-heat-templates-7.0.0-0.20170821194253.el7ost.noarch
openstack-heat-engine-9.0.0-0.20170821132121.22d7142.el7ost.noarch
puppet-heat-11.3.0-0.20170805100105.70232ae.el7ost.noarch



Steps to Reproduce:
-------------------
1. Setup RHOS
2. Update uc
3. Prepare for oc update
4. Try to setup heat's output
5. Try to delete overcloud
Comment 2 Lukas Bezdicka 2017-08-31 13:53:27 UTC 
2017-08-31 04:19:58.558 10722 INFO heat.engine.resource [req-9a7277ef-8809-490d-af03-8b71355ca876 - admin - default default] DELETE: Workflow WorkflowTasks_Step2 [tripleo.overcloud.workflowtasks.step2] Stack │··························overcloud-AllNodesDeploySteps-y6244gjac3sv [b757653f-8fdb-481d-80cd-f94358e58a66]                                                                                                                                 │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource Traceback (most recent call last):                                                                                                                        │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource   File /usr/lib/python2.7/site-packages/heat/engine/resource.py, line 831, in _action_recorder                                                          │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource     yield                                                                                                                                                 │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource   File /usr/lib/python2.7/site-packages/heat/engine/resource.py, line 1907, in delete                                                                   │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource     *action_args)                                                                                                                                         │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource   File /usr/lib/python2.7/site-packages/heat/engine/scheduler.py, line 334, in wrapper                                                                  │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource     step = next(subtask)                                                                                                                                  │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource   File /usr/lib/python2.7/site-packages/heat/engine/resource.py, line 884, in action_handler_task                                                       │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource     handler_data = handler(*args)                                                                                                                         │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource   File /usr/lib/python2.7/site-packages/heat/engine/resources/openstack/mistral/workflow.py, line 614, in handle_delete                                 │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource     return super(Workflow, self).handle_delete()                                                                                                          │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource   File /usr/lib/python2.7/site-packages/heat/engine/resources/signal_responder.py, line 58, in handle_delete                                            │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource     return super(SignalResponder, self).handle_delete()                                                                                                   │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource   File /usr/lib/python2.7/site-packages/heat/engine/resources/stack_user.py, line 75, in handle_delete                                                  │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource     return super(StackUser, self).handle_delete()                                                                                                         │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource   File /usr/lib/python2.7/site-packages/heat/engine/resource.py, line 1834, in handle_delete                                                            │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource     self.client_plugin().ignore_not_found(ex)                                                                                                             │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource   File /usr/lib/python2.7/site-packages/oslo_utils/excutils.py, line 342, in __call__                                                                   │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource     six.reraise(exc_type, exc_val, traceback)                                                                                                             │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource   File /usr/lib/python2.7/site-packages/heat/engine/resource.py, line 1831, in handle_delete                                                            │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource     obj.delete(self.resource_id)                                                                                                                          │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource   File /usr/lib/python2.7/site-packages/mistralclient/api/v2/workflows.py, line 110, in delete                                                          │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource     self._delete('/workflows/%s' % identifier)                                                                                                            │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource   File /usr/lib/python2.7/site-packages/mistralclient/api/base.py, line 128, in _delete                                                                 │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource     resp = self.http_client.delete(url)                                                                                                                   │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource   File /usr/lib/python2.7/site-packages/mistralclient/api/httpclient.py, line 52, in decorator                                                          │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource     resp = func(self, *args, **kwargs)                                                                                                                    │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource   File /usr/lib/python2.7/site-packages/mistralclient/api/httpclient.py, line 137, in delete                                                            │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource     **options)                                                                                                                                            │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource   File /usr/lib/python2.7/site-packages/keystoneauth1/session.py, line 869, in delete                                                                   │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource     return self.request(url, 'DELETE', **kwargs)                                                                                                          │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource   File /usr/lib/python2.7/site-packages/positional/__init__.py, line 101, in inner                                                                      │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource     return wrapped(*args, **kwargs)                                                                                                                       │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource   File /usr/lib/python2.7/site-packages/keystoneauth1/session.py, line 742, in request                                                                  │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource     raise exceptions.from_response(resp, method, url)                                                                                                     │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource NotFound: Not Found (HTTP 404)                                                                                                                            │··························2017-08-31 04:19:58.558 10722 ERROR heat.engine.resource
Comment 3 Zane Bitter 2017-09-21 14:37:11 UTC 
Patch merged in upstream stable/pike. Should get picked up in rebase.
Comment 7 Ronnie Rasouli 2017-12-07 12:39:04 UTC 
delete overcloud succeeded after minor update
Comment 10 errata-xmlrpc 2017-12-13 22:02:49 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2017:3462