Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1803869

Summary: Overcloud update converge fails when updating Octavia to OSP 15 z candidate
Product: Red Hat OpenStack Reporter: Gregory Thiemonge <gthiemon>
Component: openstack-tripleo-heat-templatesAssignee: Gregory Thiemonge <gthiemon>
Status: CLOSED ERRATA QA Contact: Carlos Goncalves <cgoncalves>
Severity: urgent Docs Contact:
Priority: urgent    
Version: 15.0 (Stein)CC: cgoncalves, gthiemon, mburns, spower, ssmolyak
Target Milestone: z2Keywords: AutomationBlocker, Triaged, ZStream
Target Release: 15.0 (Stein)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: openstack-tripleo-heat-templates-10.6.3-0.20200113185560.cf467ea.el8ost Doc Type: No Doc Update
Doc Text:
Story Points: ---
Clone Of: 1803718 Environment:
Last Closed: 2020-03-05 12:01:54 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1803718    
Bug Blocks:    

Description Gregory Thiemonge 2020-02-17 15:54:53 UTC 
+++ This bug was initially created as a clone of Bug #1803718 +++

Overcloud update converge fails when updating Octavia to OSP 16 z1 candidate. Bug also affects OSP15


Version-Release number of selected component (if applicable):

  From: GA
  To: passed_phase2 (RHOS_TRUNK-16.0-RHEL-8-20200213.n.1)

How reproducible: 100%


Steps to Reproduce:
1. Run OSP 16 update from GA to RHOS_TRUNK-16.0-RHEL-8-20200213.n.1 (z1 candidate)
2. The update will fail while executing "openstack overcloud update converge"

Actual results:

2020-02-16 18:52:22 | TASK [Configure octavia command] ***********************************************
2020-02-16 18:52:22 | Sunday 16 February 2020  18:49:53 +0000 (0:00:00.136)       0:27:36.744 ******* 
2020-02-16 18:52:22 | ok: [undercloud]
2020-02-16 18:52:22 | 
2020-02-16 18:52:22 | TASK [set_fact] ****************************************************************
2020-02-16 18:52:22 | Sunday 16 February 2020  18:49:53 +0000 (0:00:00.137)       0:27:36.882 ******* 
2020-02-16 18:52:22 | ok: [undercloud]
2020-02-16 18:52:22 | 
2020-02-16 18:52:22 | TASK [debug] *******************************************************************
2020-02-16 18:52:22 | Sunday 16 February 2020  18:49:53 +0000 (0:00:00.138)       0:27:37.020 ******* 
2020-02-16 18:52:22 | ok: [undercloud] => {
2020-02-16 18:52:22 |     "msg": "Configure Octavia command is: ANSIBLE_CONFIG=\"/var/lib/mistral/overcloud/ansible.cfg\" ansible-playbook -i \"/var/lib/mistral/overcloud/octavia-ansible/inventory.yaml\" --extra-vars @/var/lib/mistral/overcloud/octavia-ansible/group_vars/octavia_vars.yaml --private-key /var/lib/mistral/overcloud/ssh_private_key /usr/share/ansible/tripleo-playbooks/octavia-files.yaml"
2020-02-16 18:52:22 | }
2020-02-16 18:52:22 | 
2020-02-16 18:52:22 | TASK [Configure octavia on overcloud] ******************************************
2020-02-16 18:52:22 | Sunday 16 February 2020  18:49:53 +0000 (0:00:00.138)       0:27:37.159 ******* 
2020-02-16 18:52:22 | changed: [undercloud]
2020-02-16 18:52:25 | 
2020-02-16 18:52:25 | 
2020-02-16 18:52:25 | TASK [Purge temp dirs] *********************************************************
2020-02-16 18:52:25 | Sunday 16 February 2020  18:52:22 +0000 (0:02:28.703)       0:30:05.862 ******* 
2020-02-16 18:52:25 | failed: [undercloud] (item=/var/lib/mistral/overcloud/octavia-ansible/local_dir) => {"ansible_loop_var": "item", "changed": false, "item": "/var/lib/mistral/overcloud/octavia-ansible/local_dir", "msg": "rmtree failed: [Errno 13] Permission denied: '/var/lib/mistral/overcloud/octavia-ansible/local_dir'"}
2020-02-16 18:52:25 | 
2020-02-16 18:52:25 | NO MORE HOSTS LEFT *************************************************************
2020-02-16 18:52:25 | 
2020-02-16 18:52:25 | PLAY RECAP *********************************************************************
2020-02-16 18:52:25 | compute-0                  : ok=256  changed=96   unreachable=0    failed=0    skipped=151  rescued=0    ignored=1   
2020-02-16 18:52:25 | compute-1                  : ok=252  changed=96   unreachable=0    failed=0    skipped=151  rescued=0    ignored=1   
2020-02-16 18:52:25 | controller-0               : ok=347  changed=136  unreachable=0    failed=0    skipped=155  rescued=0    ignored=1   
2020-02-16 18:52:25 | controller-1               : ok=299  changed=127  unreachable=0    failed=0    skipped=165  rescued=0    ignored=1   
2020-02-16 18:52:25 | controller-2               : ok=299  changed=127  unreachable=0    failed=0    skipped=165  rescued=0    ignored=1   
2020-02-16 18:52:25 | undercloud                 : ok=24   changed=10   unreachable=0    failed=1    skipped=64   rescued=0    ignored=0   
2020-02-16 18:52:25 | 
2020-02-16 18:52:25 | Sunday 16 February 2020  18:52:22 +0000 (0:00:00.376)       0:30:06.239 ******* 
2020-02-16 18:52:25 | =============================================================================== 
2020-02-16 18:52:25 | 
2020-02-16 18:52:25 | Ansible failed, check log at /var/lib/mistral/overcloud/ansible.log.
2020-02-16 18:52:25 | 2020-02-16 18:52:25.080 271008 ERROR openstack [-] Overcloud configuration failed.: tripleoclient.exceptions.DeploymentError: Overcloud configuration failed.ESC[00m
2020-02-16 18:52:25 | 2020-02-16 18:52:25.086 271008 INFO osc_lib.shell [-] END return value: 1ESC[00m
Comment 5 Alex McLeod 2020-02-20 14:22:19 UTC 
If this bug requires doc text for errata release, please set the 'Doc Type' and provide draft text according to the template in the 'Doc Text' field. The documentation team will review, edit, and approve the text.

If this bug does not require doc text, please set the 'requires_doc_text' flag to '-'.
Comment 10 errata-xmlrpc 2020-03-05 12:01:54 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:0643