Bug 1279649 - Director Update 7.0 to 7.1: update fails on HA deployment with network isolation
Summary: Director Update 7.0 to 7.1: update fails on HA deployment with network isolation
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: rhosp-director
Version: 7.0 (Kilo)
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: y2
: 7.0 (Kilo)
Assignee: Jiri Stransky
QA Contact: Marius Cornea
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2015-11-09 23:32 UTC by Marius Cornea
Modified: 2015-12-21 16:57 UTC (History)
9 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Due to various issues with updating the Overcloud heat stack, updates from 7.0 to 7.1 with network isolation would not work. This fix corrects these issues. Now you can update deployments from 7.0 to 7.2 directly. Updates from 7.0 to 7.1 should be skipped. Ensure to to follow the documented update procedure, as additional Heat environment files are needed depending on the configuration of particular deployments.
Clone Of:
Environment:
Last Closed: 2015-12-21 16:57:58 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)
deployment error (23.08 KB, text/plain)
2015-11-09 23:32 UTC, Marius Cornea
no flags Details
controller0 sosreport (14.11 MB, application/x-xz)
2015-11-09 23:34 UTC, Marius Cornea
no flags Details
controller1 sosreport (13.98 MB, application/x-xz)
2015-11-09 23:37 UTC, Marius Cornea
no flags Details
controller2 sosreport (13.55 MB, application/x-xz)
2015-11-09 23:38 UTC, Marius Cornea
no flags Details
compute0 sosreport (6.81 MB, application/x-xz)
2015-11-09 23:40 UTC, Marius Cornea
no flags Details
update.yaml (2.23 KB, text/plain)
2015-11-09 23:58 UTC, Marius Cornea
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2015:2651 0 normal SHIPPED_LIVE Red Hat Enterprise Linux OSP 7 director Bug Fix Advisory 2015-12-21 21:50:26 UTC

Description Marius Cornea 2015-11-09 23:32:05 UTC
Created attachment 1091995 [details]
deployment error

Description of problem:
Updating from 7.0 to 7.1 fails on HA deployment(3 x ctrls + 1 x compute) with network isolation.

Version-Release number of selected component (if applicable):
openstack-tripleo-heat-templates-0.8.6-71.el7ost.noarch

How reproducible:
100%

Steps to Reproduce:
1. Deploy 7.0
openstack overcloud deploy --templates ~/templates-7.0/my-overcloud -e ~/templates-7.0/my-overcloud/environments/network-isolation.yaml -e ~/templates-7.0/network-environment.yaml  --control-scale 3 --compute-scale 1 --ntp-server clock.redhat.com --libvirt-type qemu

2. Update undercloud to 7.1

3. Update stack
openstack overcloud update stack overcloud -i --templates ~/templates-7.1/my-overcloud -e ~/templates-7.1/my-overcloud/overcloud-resource-registry-puppet.yaml -e ~/templates-7.1/my-overcloud/environments/network-isolation.yaml -e ~/templates-7.1/network-environment.yaml  -e ~/templates-7.1/update.yaml

Actual results:
Update fails.

Expected results:
Update succeeds. 

Additional info:
Attaching the error in the deployment show and sosreports from the overcloud nodes.

Comment 2 Marius Cornea 2015-11-09 23:34:42 UTC
Created attachment 1091996 [details]
controller0 sosreport

Comment 3 Marius Cornea 2015-11-09 23:37:15 UTC
Created attachment 1091997 [details]
controller1 sosreport

Comment 4 Marius Cornea 2015-11-09 23:38:42 UTC
Created attachment 1091998 [details]
controller2 sosreport

Comment 5 Marius Cornea 2015-11-09 23:40:50 UTC
Created attachment 1091999 [details]
compute0 sosreport

Comment 6 Marius Cornea 2015-11-09 23:58:13 UTC
Created attachment 1092017 [details]
update.yaml

Comment 7 Marius Cornea 2015-11-11 17:24:25 UTC
This looks similar to the initial report in BZ#1272347 (services are restarted via systemd) but the update.yaml contains the workaround and it still failed( https://bugzilla.redhat.com/show_bug.cgi?id=1272347#c7 )

Comment 9 Amit Ugol 2015-12-10 06:29:24 UTC
7.0 upgrade to 7.2 works, 7.0 to 7.1 won't be supported.
is this bug valid still?

Comment 10 Jiri Stransky 2015-12-10 12:45:31 UTC
I think the bug is valid (7.0 to 7.1 has issues). The issues are addressed in 7.2, so the fix for this bug is to upgrade 7.0 to 7.2 directly (following the documented procedure) instead of attempting 7.0 to 7.1. So if 7.0 to 7.2 with network isolation works, i'd consider this fixed.

Comment 12 Marius Cornea 2015-12-13 00:39:08 UTC
Got a passed update from 7.0 to 7.2 with 3 controllers, 1 compute and 3 ceph nodes by using network isolation.

Comment 14 errata-xmlrpc 2015-12-21 16:57:58 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2015:2651


Note You need to log in before you can comment on or make changes to this bug.