Bug 1803749

Summary:	Overcloud update converge fails when updating Octavia to OSP 13 z11 candidate
Product:	Red Hat OpenStack	Reporter:	Carlos Goncalves <cgoncalves>
Component:	openstack-tripleo-common	Assignee:	Carlos Goncalves <cgoncalves>
Status:	CLOSED ERRATA	QA Contact:	Bruna Bonguardo <bbonguar>
Severity:	urgent	Docs Contact:
Priority:	urgent
Version:	13.0 (Queens)	CC:	atragler, bbonguar, mburns, michjohn, slinaber
Target Milestone:	z11	Keywords:	AutomationBlocker, Regression, Triaged, ZStream
Target Release:	13.0 (Queens)
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:	openstack-tripleo-common-8.7.1-12.el7ost	Doc Type:	No Doc Update
Doc Text:		Story Points:	---
Clone Of:	1803708	Environment:
Last Closed:	2020-03-10 11:24:20 UTC	Type:	---
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:	1803708
Bug Blocks:

Description Carlos Goncalves 2020-02-17 11:05:21 UTC

+++ This bug was initially created as a clone of Bug #1803708 +++

Overcloud update converge fails when updating Octavia to OSP 13 z11 candidate.

Version-Release number of selected component (if applicable):

  From: zstream prior to z11
  To: z11spin2 (OpenStack-13.0-RHEL-7-20200214.1)


How reproducible: 100%


Steps to Reproduce:
1. Run OSP 13 update to z11spin2 (OpenStack-13.0-RHEL-7-20200214.1)
2. The update will fail while executing "openstack overcloud update converge"


Actual results:

NOTE: these are logs from an OSP 15 update. We are running updates in downstream CI for OSP 13 right now.

undercloud:/var/lib/mistral/overcloud/octavia-ansible/octavia-ansible.log

2020-02-16 21:36:29,806 p=350480 u=root |  TASK [octavia-controller-post-config : check if ip list needs updating] ********
2020-02-16 21:36:29,913 p=350480 u=root |  ok: [controller-0]
2020-02-16 21:36:30,009 p=350480 u=root |  ok: [controller-1]
2020-02-16 21:36:30,026 p=350480 u=root |  ok: [controller-2]
2020-02-16 21:36:30,116 p=350480 u=root |  TASK [octavia-controller-post-config : setting [health_manager]/controller_ip_port_list] ***
2020-02-16 21:36:30,790 p=350480 u=root |  changed: [controller-0]
2020-02-16 21:36:30,912 p=350480 u=root |  changed: [controller-1]
2020-02-16 21:36:30,973 p=350480 u=root |  changed: [controller-2]
2020-02-16 21:36:31,065 p=350480 u=root |  TASK [octavia-controller-post-config : create a symbolic link conf.d/post-deploy -> post-deploy.conf (LP#1836074)] ***
2020-02-16 21:36:31,754 p=350480 u=root |  fatal: [controller-0]: FAILED! => {"changed": false, "gid": 0, "group": "root", "mode": "0644", "msg": "refusing to convert from file to symlink for /var/lib/config-data/puppet-generated/octavia/etc/octavia/conf.d/common/post-deploy.conf", "owner": "root", "path": "/var/lib/config-data/puppet-generated/octavia/etc/octavia/conf.d/common/post-deploy.conf", "secontext": "system_u:object_r:container_file_t:s0", "size": 193, "state": "file", "uid": 0}
2020-02-16 21:36:31,863 p=350480 u=root |  fatal: [controller-1]: FAILED! => {"changed": false, "gid": 0, "group": "root", "mode": "0644", "msg": "refusing to convert from file to symlink for /var/lib/config-data/puppet-generated/octavia/etc/octavia/conf.d/common/post-deploy.conf", "owner": "root", "path": "/var/lib/config-data/puppet-generated/octavia/etc/octavia/conf.d/common/post-deploy.conf", "secontext": "system_u:object_r:container_file_t:s0", "size": 193, "state": "file", "uid": 0}
2020-02-16 21:36:31,920 p=350480 u=root |  fatal: [controller-2]: FAILED! => {"changed": false, "gid": 0, "group": "root", "mode": "0644", "msg": "refusing to convert from file to symlink for /var/lib/config-data/puppet-generated/octavia/etc/octavia/conf.d/common/post-deploy.conf", "owner": "root", "path": "/var/lib/config-data/puppet-generated/octavia/etc/octavia/conf.d/common/post-deploy.conf", "secontext": "system_u:object_r:container_file_t:s0", "size": 193, "state": "file", "uid": 0}
2020-02-16 21:36:31,921 p=350480 u=root |  PLAY RECAP *********************************************************************
2020-02-16 21:36:31,921 p=350480 u=root |  controller-0               : ok=51   changed=13   unreachable=0    failed=1    skipped=2    rescued=0    ignored=0   
2020-02-16 21:36:31,921 p=350480 u=root |  controller-1               : ok=37   changed=10   unreachable=0    failed=1    skipped=1    rescued=0    ignored=0   
2020-02-16 21:36:31,922 p=350480 u=root |  controller-2               : ok=37   changed=10   unreachable=0    failed=1    skipped=1    rescued=0    ignored=0   
2020-02-16 21:36:31,922 p=350480 u=root |  undercloud-0               : ok=16   changed=7    unreachable=0    failed=0    skipped=15   rescued=0    ignored=1

Comment 2 Carlos Goncalves 2020-02-17 16:02:56 UTC

Bug confirmed in OSP 13 z11 candidate.

undercloud:/var/log/mistral/engine.log
undercloud:/home/stack/overcloud_update_converge.log

fatal: [192.168.24.8]: FAILED! => {"changed": false, "gid": 0, "group": "root", "mode": "0644", "msg": "refusing to convert from file to symlink for /var/lib/config-data/puppet-generated/octavia/etc/octavia/conf.d/common/post-deploy.conf", "owner": "root", "path": "/var/lib/config-data/puppet-generated/octavia/etc/octavia/conf.d/common/post-deploy.conf", "secontext": "system_u:object_r:var_lib_t:s0", "size": 193, "state": "file", "uid": 0}\nfatal: [192.168.24.12]: FAILED! => {"changed": false, "gid": 0, "group": "root", "mode": "0644", "msg": "refusing to convert from file to symlink for /var/lib/config-data/puppet-generated/octavia/etc/octavia/conf.d/common/post-deploy.conf", "owner": "root", "path": "/var/lib/config-data/puppet-generated/octavia/etc/octavia/conf.d/common/post-deploy.conf", "secontext": "system_u:object_r:var_lib_t:s0", "size": 193, "state": "file", "uid": 0}\nfatal: [192.168.24.6]: FAILED! => {"changed": false, "gid": 0, "group": "root", "mode": "0644", "msg": "refusing to convert from file to symlink for /var/lib/config-data/puppet-generated/octavia/etc/octavia/conf.d/common/post-deploy.conf", "owner": "root", "path": "/var/lib/config-data/puppet-generated/octavia/etc/octavia/conf.d/common/post-deploy.conf", "secontext": "system_u:object_r:var_lib_t:s0", "size": 193, "state": "file", "uid": 0}\n\nPLAY RECAP *********************************************************************\n192.168.24.12              : ok=36   changed=10   unreachable=0    failed=1   \n192.168.24.6               : ok=36   changed=10   unreachable=0    failed=1   \n192.168.24.8               : ok=49   changed=13   unreachable=0    failed=1

Comment 16 Michael Johnson 2020-02-28 18:00:02 UTC

I am marking this as verified.

I have confirmed that the fix is included in the openstack-tripleo-common-8.7.1-12.el7ost rpm.

CI testing has show the issue to be resolved by this change.

Comment 19 errata-xmlrpc 2020-03-10 11:24:20 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:0760