Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1279988

Summary: openstack overcloud package update removes namespaces
Product: Red Hat OpenStack Reporter: Ondrej <ochalups>
Component: openstack-tripleoAssignee: James Slagle <jslagle>
Status: CLOSED ERRATA QA Contact: Alexander Chuzhoy <sasha>
Severity: unspecified Docs Contact:
Priority: high    
Version: 7.0 (Kilo)CC: calfonso, chorn, dmacpher, dmesser, kbasil, mburns, mschuppe, ohochman, rhel-osp-director-maint, sasha, yeylon
Target Milestone: y2Keywords: TestOnly, Triaged
Target Release: 7.0 (Kilo)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2015-12-21 16:58:07 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1290377    

Description Ondrej 2015-11-10 16:25:13 UTC
Description of problem:

openstack overcloud update stack --templates ~/templates/my-overcloud -e ~/templates/my-overcloud/environments/network-isolation.yaml -e ~/templates/network-environment.yaml -e ~/templates/post-config.yaml  -e ~/templates/storage-environment.yaml -i osp7r2


If overcloud update is ran for the environment(3 controllers in ha, 3 computes), during update of clustered (pacemaker) controller nodes, namespaces are flushed and
instances loose connection as gateway addresses are gone when pacemaker rolls the services. None of the 3 controllers has the configuration. 
Probably due to netns-cleanup is ran before its configuration is passed on:

Nov 09 11:18:22 osp7r2-controller-1.localdomain pengine[1866]: notice: Move    ip-10.111.150.1        (Started osp7r2-controller-1 -> osp7r2-controller-0)


grep -e pengine\\[ -e pengine /sos_commands/cluster/crm_report/osp7r2-controller-1.localdomain/journal.log

Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Demote  galera:1        (Master -> Stopped osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Move    ip-192.168.124.21        (Started osp7r2-controller-2 -> osp7r2-controller-0)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    redis:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Move    ip-192.168.122.79        (Started osp7r2-controller-2 -> osp7r2-controller-1)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    mongod:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    rabbitmq:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    memcached:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    fs-varlibglanceimages:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    openstack-nova-scheduler:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    neutron-l3-agent:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    openstack-ceilometer-alarm-notifier:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    openstack-heat-engine:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    openstack-ceilometer-api:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    neutron-metadata-agent:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    neutron-ovs-cleanup:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    neutron-netns-cleanup:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    openstack-heat-api:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    openstack-cinder-scheduler:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    openstack-nova-api:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    openstack-heat-api-cloudwatch:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    openstack-ceilometer-collector:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    openstack-keystone:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    openstack-nova-consoleauth:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    openstack-glance-registry:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    openstack-ceilometer-notification:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    openstack-cinder-api:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    neutron-dhcp-agent:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    openstack-glance-api:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    neutron-openvswitch-agent:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    openstack-nova-novncproxy:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    delay:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    neutron-server:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    httpd:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    openstack-ceilometer-central:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    openstack-ceilometer-alarm-evaluator:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    openstack-heat-api-cfn:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Stop    openstack-nova-conductor:1        (osp7r2-controller-2)
Nov 09 11:06:01 osp7r2-controller-1.localdomain pengine[1866]: notice: Calculated Transition 333: /var/lib/pacemaker/pengine/pe-input-56.bz2


[root@osp7r2-controller-0 ~]# ip netns list
qrouter-e2d4fef6-eb8d-487e-aa83-c0db2a701b8f
qdhcp-3104a4bb-bd54-4b03-b90f-18d95fdd7088
qdhcp-e2459843-c80f-4f75-9d63-1342cc04b2f1


[root@osp7r2-controller-0 ~]# ip netns exec qrouter-e2d4fef6-eb8d-487e-aa83-c0db2a701b8f ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
26: ha-ea61ad13-f3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN
    link/ether fa:16:3e:61:93:7d brd ff:ff:ff:ff:ff:ff
    inet 169.254.192.3/18 brd 169.254.255.255 scope global ha-ea61ad13-f3
       valid_lft forever preferred_lft forever
    inet6 fe80::f816:3eff:fe61:937d/64 scope link
       valid_lft forever preferred_lft forever
27: qr-a0cdc8f9-aa: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN
    link/ether fa:16:3e:c9:d0:05 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::f816:3eff:fec9:d005/64 scope link
       valid_lft forever preferred_lft forever
28: qr-e797590f-88: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN
    link/ether fa:16:3e:c5:5a:8a brd ff:ff:ff:ff:ff:ff
    inet6 fe80::f816:3eff:fec5:5a8a/64 scope link
       valid_lft forever preferred_lft forever
29: qg-6f9e450b-22: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN
    link/ether fa:16:3e:85:c0:33 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::f816:3eff:fe85:c033/64 scope link
       valid_lft forever preferred_lft forever




[root@osp7r2-controller-0 ~]# pcs status
Cluster name: tripleo_cluster
Last updated: Tue Nov 10 14:48:53 2015          Last change: Tue Nov 10 14:48:50 2015 by hacluster via crmd on osp7r2-controller-0
Stack: corosync
Current DC: osp7r2-controller-2 (version 1.1.13-a14efad) - partition with quorum
3 nodes and 115 resources configured

Online: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]

Full list of resources:

 Clone Set: haproxy-clone [haproxy]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 ip-10.111.150.1        (ocf::heartbeat:IPaddr2):       Started osp7r2-controller-0
 ip-192.168.124.20      (ocf::heartbeat:IPaddr2):       Started osp7r2-controller-2
 Master/Slave Set: galera-master [galera]
     Masters: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 ip-192.168.124.21      (ocf::heartbeat:IPaddr2):       Started osp7r2-controller-2
 ip-192.168.126.20      (ocf::heartbeat:IPaddr2):       Started osp7r2-controller-2
 ip-192.168.128.30      (ocf::heartbeat:IPaddr2):       Started osp7r2-controller-0
 Master/Slave Set: redis-master [redis]
     Masters: [ osp7r2-controller-2 ]
     Slaves: [ osp7r2-controller-0 osp7r2-controller-1 ]
 ip-192.168.122.79      (ocf::heartbeat:IPaddr2):       Started osp7r2-controller-0
 Clone Set: mongod-clone [mongod]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: rabbitmq-clone [rabbitmq]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: memcached-clone [memcached]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: fs-varlibglanceimages-clone [fs-varlibglanceimages]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: openstack-nova-scheduler-clone [openstack-nova-scheduler]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: neutron-l3-agent-clone [neutron-l3-agent]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: openstack-ceilometer-alarm-notifier-clone [openstack-ceilometer-alarm-notifier]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: openstack-heat-engine-clone [openstack-heat-engine]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: openstack-ceilometer-api-clone [openstack-ceilometer-api]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: neutron-metadata-agent-clone [neutron-metadata-agent]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: neutron-ovs-cleanup-clone [neutron-ovs-cleanup]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: neutron-netns-cleanup-clone [neutron-netns-cleanup]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: openstack-heat-api-clone [openstack-heat-api]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: openstack-cinder-scheduler-clone [openstack-cinder-scheduler]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: openstack-nova-api-clone [openstack-nova-api]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: openstack-heat-api-cloudwatch-clone [openstack-heat-api-cloudwatch]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: openstack-ceilometer-collector-clone [openstack-ceilometer-collector]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: openstack-keystone-clone [openstack-keystone]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: openstack-nova-consoleauth-clone [openstack-nova-consoleauth]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: openstack-glance-registry-clone [openstack-glance-registry]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: openstack-ceilometer-notification-clone [openstack-ceilometer-notification]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: openstack-cinder-api-clone [openstack-cinder-api]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: neutron-dhcp-agent-clone [neutron-dhcp-agent]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: openstack-glance-api-clone [openstack-glance-api]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: neutron-openvswitch-agent-clone [neutron-openvswitch-agent]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: openstack-nova-novncproxy-clone [openstack-nova-novncproxy]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: delay-clone [delay]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: neutron-server-clone [neutron-server]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: httpd-clone [httpd]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: openstack-ceilometer-central-clone [openstack-ceilometer-central]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: openstack-ceilometer-alarm-evaluator-clone [openstack-ceilometer-alarm-evaluator]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 Clone Set: openstack-heat-api-cfn-clone [openstack-heat-api-cfn]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]
 openstack-cinder-volume        (systemd:openstack-cinder-volume):      Started osp7r2-controller-2
 Clone Set: openstack-nova-conductor-clone [openstack-nova-conductor]
     Started: [ osp7r2-controller-0 osp7r2-controller-1 osp7r2-controller-2 ]

PCSD Status:
  osp7r2-controller-0: Online
  osp7r2-controller-1: Online
  osp7r2-controller-2: Online

Daemon Status:
  corosync: active/enabled
  pacemaker: active/enabled
  pcsd: active/enabled





Version-Release number of selected component (if applicable):
pacemaker-1.1.12-22.el7_1.4.x86_64
pacemaker-cli-1.1.12-22.el7_1.4.x86_64
pacemaker-cluster-libs-1.1.12-22.el7_1.4.x86_64
pacemaker-libs-1.1.12-22.el7_1.4.x86_64
pacemaker-remote-1.1.12-22.el7_1.4.x86_64
openstack-neutron-2015.1.1-7.el7ost.noarch
openstack-neutron-bigswitch-lldp-2015.1.38-1.el7ost.noarch
openstack-neutron-common-2015.1.1-7.el7ost.noarch
openstack-neutron-lbaas-2015.1.1-1.el7ost.noarch
openstack-neutron-metering-agent-2015.1.1-7.el7ost.noarch
openstack-neutron-ml2-2015.1.1-7.el7ost.noarch
openstack-neutron-openvswitch-2015.1.1-7.el7ost.noarch
openstack-nova-api-2015.1.1-3.el7ost.noarch
openstack-nova-cert-2015.1.1-3.el7ost.noarch
openstack-nova-common-2015.1.1-3.el7ost.noarch
openstack-nova-compute-2015.1.1-3.el7ost.noarch
openstack-nova-conductor-2015.1.1-3.el7ost.noarch
openstack-nova-console-2015.1.1-3.el7ost.noarch
openstack-nova-novncproxy-2015.1.1-3.el7ost.noarch
openstack-nova-scheduler-2015.1.1-3.el7ost.noarch

How reproducible:


Steps to Reproduce:
1.update overcloud
2.
3.

Actual results:
overcloud upgraded, instances loose connection because the namepaces were removed.

Expected results:
overcloud upgraded, instances keep connection

Additional info:

Comment 2 Ondrej 2015-11-18 10:51:22 UTC
Updating the compute nodes only, doesn't seem to work either as the controller nodes can't be skipped,and when cancelled, the rollback probably causes restart of the services, causing the namespaces to be flushed and connection lost again.
Steps:
stack@osp7dr1 ~(UC)]$ openstack overcloud update stack --templates ~/templates/my-overcloud -e ~/templates/my-overcloud/environments/network-isolation.yaml -e ~/templates/network-environment.yaml -e ~/templates/pre-deployment.yaml  -e ~/templates/post-deployment.yaml  -e ~/templates/environment.yaml -i osp7r2
starting package update on stack osp7r2
IN_PROGRESS
IN_PROGRESS
...
WAITING
not_started: [u'osp7r2-compute-1', u'osp7r2-controller-0', u'osp7r2-controller-2']
on_breakpoint: [u'osp7r2-compute-0', u'osp7r2-controller-1', u'osp7r2-compute-2']
Breakpoint reached, continue? Regexp or Enter=proceed, no=cancel update, C-c=quit interactive mode: osp7r2-compute-0
removing breakpoint on osp7r2-compute-0
IN_PROGRESS
IN_PROGRESS
IN_PROGRESS
WAITING
completed: [u'osp7r2-compute-0']
on_breakpoint: [u'osp7r2-compute-1', u'osp7r2-controller-1', u'osp7r2-compute-2', u'osp7r2-controller-0', u'osp7r2-controller-2']
Breakpoint reached, continue? Regexp or Enter=proceed, no=cancel update, C-c=quit interactive mode: osp7r2-compute-1
removing breakpoint on osp7r2-compute-1
IN_PROGRESS
IN_PROGRESS
IN_PROGRESS
WAITING
completed: [u'osp7r2-compute-0', u'osp7r2-compute-1']
on_breakpoint: [u'osp7r2-controller-1', u'osp7r2-compute-2', u'osp7r2-controller-0', u'osp7r2-controller-2']
Breakpoint reached, continue? Regexp or Enter=proceed, no=cancel update, C-c=quit interactive mode: osp7r2-compute-2
removing breakpoint on osp7r2-compute-2
IN_PROGRESS
IN_PROGRESS
IN_PROGRESS
IN_PROGRESS
WAITING
completed: [u'osp7r2-compute-0', u'osp7r2-compute-2', u'osp7r2-compute-1']
on_breakpoint: [u'osp7r2-controller-1', u'osp7r2-controller-0', u'osp7r2-controller-2']
Breakpoint reached, continue? Regexp or Enter=proceed, no=cancel update, C-c=quit interactive mode: c
WAITING
completed: [u'osp7r2-compute-0', u'osp7r2-compute-2', u'osp7r2-compute-1']
on_breakpoint: [u'osp7r2-controller-1', u'osp7r2-controller-0', u'osp7r2-controller-2']
Breakpoint reached, continue? Regexp or Enter=proceed, no=cancel update, C-c=quit interactive mode: no
canceling update, doing rollback
canceling update, doing rollback
removing breakpoint on osp7r2-controller-1
removing breakpoint on osp7r2-controller-0
removing breakpoint on osp7r2-controller-2
IN_PROGRESS
FAILED
update finished with status FAILED

Comment 4 Alexander Chuzhoy 2015-12-11 17:00:12 UTC
Verified:
Environment:
openstack-nova-novncproxy-2015.1.2-7.el7ost.noarch
openstack-nova-cert-2015.1.2-7.el7ost.noarch
openstack-neutron-common-2015.1.2-2.el7ost.noarch
openstack-nova-conductor-2015.1.2-7.el7ost.noarch
openstack-nova-api-2015.1.2-7.el7ost.noarch
openstack-nova-common-2015.1.2-7.el7ost.noarch
openstack-neutron-ml2-2015.1.2-2.el7ost.noarch
openstack-nova-scheduler-2015.1.2-7.el7ost.noarch
openstack-neutron-openvswitch-2015.1.2-2.el7ost.noarch
openstack-neutron-2015.1.2-2.el7ost.noarch
openstack-nova-console-2015.1.2-7.el7ost.noarch
openstack-nova-compute-2015.1.2-7.el7ost.noarch
instack-undercloud-2.1.2-34.el7ost.noarch

Deployed 7.1 overcloud, launched instances, verified connectivity.
Updated the overcloud to 7.2 and verified the instances were still accessible.

Comment 6 James Slagle 2015-12-17 20:44:17 UTC
no doc text required per mburns

Comment 8 errata-xmlrpc 2015-12-21 16:58:07 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2015:2651