Bug 1324736

Summary: [rhel-ospd][upgrade] overcloud upgrade fails from ospd 7.3 HA +external LB --->ospd8
Product: Red Hat OpenStack Reporter: Leonid Natapov <lnatapov>
Component: rhosp-directorAssignee: Giulio Fidente <gfidente>
Status: CLOSED WORKSFORME QA Contact: Arik Chernetsky <achernet>
Severity: high Docs Contact:
Priority: unspecified    
Version: 8.0 (Liberty)CC: brad, dbecker, gfidente, lnatapov, mburns, morazi, rhel-osp-director-maint
Target Milestone: ---   
Target Release: 10.0 (Newton)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-04-08 16:22:26 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Leonid Natapov 2016-04-07 07:08:49 UTC 
Description of problem:

I am trying to upgrade from ospd 7.3 GA to ospd8.
I have HA + External Load Balancer environment.

I have the following error:
-------------------------------
 resource_status_reason | resources.Controller: resources[0]: StackValidationFailed: resources.Controller: Property error: Controller.Properties.networks[0].network: Error validating value 'ctlpla
ne': Request Failed: internal server error while processing your request. |
| resource_type          | OS::Heat::ResourceGroup                     

Full output you can see here:
http://pastebin.test.redhat.com/363274
  

Deploy command I used for upgrade:
-----------------------------------
openstack overcloud deploy  --templates /usr/share/openstack-tripleo-heat-templates -e   /usr/share/openstack-tripleo-heat-templates/overcloud-resource-registry-puppet.yaml  -e  /usr/share/openstack-tripleo-heat-templates/environments/puppet-pacemaker.yaml  -e  /usr/share/openstack-tripleo-heat-templates/environments/network-isolation.yaml  -e  /usr/share/openstack-tripleo-heat-templates/environments/net-single-nic-with-vlans.yaml  -e /home/stack/network-environment.yaml -e  /usr/share/openstack-tripleo-heat-templates/environments/major-upgrade-pacemaker-init.yaml  -e /home/stack/rhos-release-8.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/external-loadbalancer-vip.yaml -e external-lb.yaml

Deploy command I used to deploy ospd 7.3 with ex-lb.
----------------------------------------------------
openstack overcloud deploy --templates  -e /usr/share/openstack-tripleo-heat-templates/environments/network-isolation.yaml -e network-environment.yaml --control-scale 3 --compute-scale 1 --ntp-server 10.11.160.238 -e /usr/share/openstack-tripleo-heat-templates/environments/external-loadbalancer-vip.yaml -e external-lb.yaml

ospd8 + ex-lb can be successfully deployed from scratch.

I am keeping the env. for debugging. Details in the comment.
Comment 4 Giulio Fidente 2016-04-07 13:44:41 UTC 
It is actually neutron returning internal server error to a heat request; this could be heat trying to do something it shouldn't (based on env files errors), continuing investigation.
Comment 5 Brad P. Crochet 2016-04-07 14:38:48 UTC 
Can you verify that the two commands used are indeed different? The initial deploy does not have the single-nic-with-vlans environment, whereas the upgrade command does contain that. If they are different, please try this again, but ensure that the environment files are consistent between the two runs.
Comment 7 Mike Burns 2016-04-07 21:36:02 UTC 
This bug did not make the OSP 8.0 release.  It is being deferred to OSP 10.
Comment 8 Giulio Fidente 2016-04-08 16:07:58 UTC 
Leonid, I think the more recent attempt passed. Shall we close this?
Comment 9 Leonid Natapov 2016-04-08 16:17:48 UTC 
(In reply to Giulio Fidente from comment #8)
> Leonid, I think the more recent attempt passed. Shall we close this?

Hi,yes.
When I attempted to upgrade using the following deploy command(without single-nic) it went smooth and update successfully finished.

Here is the deploy command.

openstack overcloud deploy  --templates /usr/share/openstack-tripleo-heat-templates -e   /usr/share/openstack-tripleo-heat-templates/overcloud-resource-registry-puppet.yaml  -e  /usr/share/openstack-tripleo-heat-templates/environments/puppet-pacemaker.yaml  -e  /usr/share/openstack-tripleo-heat-templates/environments/network-isolation.yaml   -e /home/stack/network-environment.yaml -e  /usr/share/openstack-tripleo-heat-templates/environments/major-upgrade-pacemaker-init.yaml  -e /home/stack/rhos-release-8.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/external-loadbalancer-vip.yaml -e external-lb.yaml