Bug 1493096

Summary: Failed stack update as director tries to delete/recreate networks/subnets/ports/vip's
Product: Red Hat OpenStack Reporter: Luca Miccini <lmiccini>
Component: python-heatclientAssignee: Steve Baker <sbaker>
Status: CLOSED ERRATA QA Contact: Ronnie Rasouli <rrasouli>
Severity: high Docs Contact:
Priority: medium    
Version: 10.0 (Newton)CC: augol, jruzicka, mburns, rhel-osp-director-maint, sbaker, sclewis, shardy, srevivo, therve, ykarel, zbitter
Target Milestone: betaKeywords: Triaged
Target Release: 13.0 (Queens)   
Hardware: All   
OS: Linux   
Whiteboard:
Fixed In Version: python-heatclient-1.14.0-0.20180213175737.2ce6aa1.el7ost Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-06-27 13:37:30 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Luca Miccini 2017-09-19 11:23:14 UTC
Description of problem:

Trying to re-deploy an already existing overcloud fails because director tries to delete and re-create networks/subnets and VIPs.

2017-09-15 11:44:24Z [ServiceNetMap]: UPDATE_COMPLETE  state changed
2017-09-15 11:45:31Z [overcloud-Networks-ldg7vrpnlbwe-ExternalNetwork-2mxurynqqauk.ExternalSubnet]: DELETE_FAILED  Conflict: resources.ExternalSubnet: Una
ble to complete operation on subnet 0be8c89c-dbd4-45c6-9f92-09710bd42efc: One or more ports have an IP allocation from this subnet.
Neutron server returns request_ids: ['req-b93a5f7b-96b2-43aa-92e3-1b45edf4f912']
2017-09-15 11:45:31Z [overcloud-Networks-ldg7vrpnlbwe-StorageNetwork-sskb6k6fxrtu.StorageSubnet]: DELETE_FAILED  Conflict: resources.StorageSubnet: Unable
 to complete operation on subnet b23a96bd-cc63-4a4b-aad2-2059f0e64e27: One or more ports have an IP allocation from this subnet.
Neutron server returns request_ids: ['req-c1e25e2c-df07-42c2-bfda-312cdb8393ce']
2017-09-15 11:45:31Z [overcloud-Networks-ldg7vrpnlbwe-ExternalNetwork-2mxurynqqauk]: DELETE_FAILED  Resource DELETE failed: Conflict: resources.ExternalSu
bnet: Unable to complete operation on subnet 0be8c89c-dbd4-45c6-9f92-09710bd42efc: One or more ports have an IP allocation from this subnet.
Neutron server returns request_ids: ['req-b93a5f7b-96b2-43aa
2017-09-15 11:45:31Z [overcloud-Networks-ldg7vrpnlbwe-StorageNetwork-sskb6k6fxrtu]: DELETE_FAILED  Resource DELETE failed: Conflict: resources.StorageSubn
et: Unable to complete operation on subnet b23a96bd-cc63-4a4b-aad2-2059f0e64e27: One or more ports have an IP allocation from this subnet.
Neutron server returns request_ids: ['req-c1e25e2c-df07-42c2-


Templates defining network configuration and options are unchanged, only changes are related to storage and ceilometer configuration parameters.

Version-Release number of selected component (if applicable):

osp10

heat-cfntools-1.3.0-2.el7ost.noarch
openstack-heat-api-7.0.5-1.el7ost.noarch
openstack-heat-api-cfn-7.0.5-1.el7ost.noarch
openstack-heat-common-7.0.5-1.el7ost.noarch
openstack-heat-engine-7.0.5-1.el7ost.noarch
openstack-heat-templates-0-0.12.1e6015dgit.el7ost.noarch
openstack-tripleo-0.0.8-0.2.4de13b3git.el7ost.noarch
openstack-tripleo-common-5.4.2-3.el7ost.noarch
openstack-tripleo-heat-templates-5.3.0-4.el7ost.noarch
openstack-tripleo-image-elements-5.3.0-2.el7ost.noarch
openstack-tripleo-puppet-elements-5.3.0-1.el7ost.noarch
openstack-tripleo-ui-1.2.0-1.el7ost.noarch
openstack-tripleo-validations-5.1.2-1.el7ost.noarch
puppet-heat-9.5.0-1.el7ost.noarch
puppet-tripleo-5.6.1-2.el7ost.noarch
python-heat-agent-0-0.12.1e6015dgit.el7ost.noarch
python-heatclient-1.5.2-1.el7ost.noarch
python-tripleoclient-5.4.2-2.el7ost.noarch


How reproducible:

unsure.

Steps to Reproduce:
1. n/a
2.
3.

Actual results:

2017-09-15 11:44:24Z [ServiceNetMap]: UPDATE_COMPLETE  state changed
2017-09-15 11:45:31Z [overcloud-Networks-ldg7vrpnlbwe-ExternalNetwork-2mxurynqqauk.ExternalSubnet]: DELETE_FAILED  Conflict: resources.ExternalSubnet: Una
ble to complete operation on subnet 0be8c89c-dbd4-45c6-9f92-09710bd42efc: One or more ports have an IP allocation from this subnet.
Neutron server returns request_ids: ['req-b93a5f7b-96b2-43aa-92e3-1b45edf4f912']
2017-09-15 11:45:31Z [overcloud-Networks-ldg7vrpnlbwe-StorageNetwork-sskb6k6fxrtu.StorageSubnet]: DELETE_FAILED  Conflict: resources.StorageSubnet: Unable
 to complete operation on subnet b23a96bd-cc63-4a4b-aad2-2059f0e64e27: One or more ports have an IP allocation from this subnet.
Neutron server returns request_ids: ['req-c1e25e2c-df07-42c2-bfda-312cdb8393ce']
2017-09-15 11:45:31Z [overcloud-Networks-ldg7vrpnlbwe-ExternalNetwork-2mxurynqqauk]: DELETE_FAILED  Resource DELETE failed: Conflict: resources.ExternalSu
bnet: Unable to complete operation on subnet 0be8c89c-dbd4-45c6-9f92-09710bd42efc: One or more ports have an IP allocation from this subnet.
Neutron server returns request_ids: ['req-b93a5f7b-96b2-43aa
2017-09-15 11:45:31Z [overcloud-Networks-ldg7vrpnlbwe-StorageNetwork-sskb6k6fxrtu]: DELETE_FAILED  Resource DELETE failed: Conflict: resources.StorageSubn
et: Unable to complete operation on subnet b23a96bd-cc63-4a4b-aad2-2059f0e64e27: One or more ports have an IP allocation from this subnet.
Neutron server returns request_ids: ['req-c1e25e2c-df07-42c2-

[stack@director10 ~]$ heat stack-list
WARNING (shell) "heat stack-list" is deprecated, please use "openstack stack list" instead
+--------------------------------------+------------+---------------+----------------------+----------------------+
| id                                   | stack_name | stack_status  | creation_time        | updated_time         |
+--------------------------------------+------------+---------------+----------------------+----------------------+
| 640ea84f-e7f1-4208-a5f4-25a9126139f2 | overcloud  | UPDATE_FAILED | 2017-04-10T22:36:27Z | 2017-09-15T11:43:55Z |
+--------------------------------------+------------+---------------+----------------------+----------------------+


Expected results:

stack to be updated successfully.

Additional info:

Comment 14 errata-xmlrpc 2018-06-27 13:37:30 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2018:2086