2078708 – [osp17] overcloud deletion fail because of incorrect permission on config download files

Bug 2078708 - [osp17] overcloud deletion fail because of incorrect permission on config download files

Summary: [osp17] overcloud deletion fail because of incorrect permission on config dow...

Keywords:
Status:	CLOSED ERRATA
Alias:	None
Product:	Red Hat OpenStack
Classification:	Red Hat
Component:	tripleo-ansible
Sub Component:
Version:	17.0 (Wallaby)
Hardware:	Unspecified
OS:	Unspecified
Priority:	medium
Severity:	high
Target Milestone:	---
Target Release:	---
Assignee:	OSP Team
QA Contact:	Joe H. Rahme
Docs Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+	depends on / blocked

Reported:	2022-04-26 05:07 UTC by Khomesh Thakre
Modified:	2022-09-21 12:21 UTC (History)
CC List:	2 users (show)
Fixed In Version:	tripleo-ansible-3.3.1-0.20220506222451.96104ee.el9ost
Doc Type:	If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:	2022-09-21 12:20:53 UTC
Target Upstream Version:
Embargoed:

Attachments	(Terms of Use)

Links
System	ID	Priority	Status	Summary	Last Updated
OpenStack gerrit	839325	None	NEW	Elevate privileges when deleting stack dir	2022-04-26 09:23:48 UTC
Red Hat Issue Tracker	OSP-14870	None	None	None	2022-04-26 05:11:21 UTC
Red Hat Product Errata	RHEA-2022:6543	None	None	None	2022-09-21 12:21:05 UTC

Description Khomesh Thakre 2022-04-26 05:07:55 UTC

Description of problem:
In OSP17, stack deletion failed with the below error.

~~~
2022-04-25 02:13:09.853062 | 52540015-530f-d8c4-f409-000000000026 |       TASK | Remove the config download stack                                            
2022-04-25 02:13:10.172708 | 52540015-530f-d8c4-f409-000000000026 |    CHANGED | Remove the config download stack | localhost                                
2022-04-25 02:13:10.174630 | 52540015-530f-d8c4-f409-000000000026 |     TIMING | Remove the config download stack | localhost | 0:00:04.628059 | 0.32s       
2022-04-25 02:13:10.179084 | 52540015-530f-d8c4-f409-000000000027 |       TASK | Remove the deploy stack                                                     
2022-04-25 02:13:10.438729 | 52540015-530f-d8c4-f409-000000000027 |      FATAL | Remove the deploy stack | localhost | error={"changed": false, "msg": "rmtre$
 failed: [Errno 13] Permission denied: 'octavia_vars.yaml'"}
2022-04-25 02:13:10.440049 | 52540015-530f-d8c4-f409-000000000027 |     TIMING | Remove the deploy stack | localhost | 0:00:04.893470 | 0.26s                

NO MORE HOSTS LEFT *************************************************************                                                                             

PLAY RECAP *********************************************************************                                                                             
localhost                  : ok=6    changed=3    unreachable=0    failed=1    skipped=2    rescued=0    ignored=0 
~~~

During further troubleshooting, I find some Octavia related files are owned by root thus causing the above failure.

~~~
[stack@undercloud-0 ~]$ ll ./overcloud-deploy/overcloud/config-download/overcloud/ -R                                                                        
./overcloud-deploy/overcloud/config-download/overcloud/:
total 0
drwxr-xr-x. 3 tripleo-admin root 73 Apr 25 02:00 octavia-ansible

./overcloud-deploy/overcloud/config-download/overcloud/octavia-ansible:
total 60
drwxr-xr-x. 2 tripleo-admin root    31 Apr 25 01:56 group_vars
-rw-r--r--. 1 root          root   643 Apr 25 01:56 inventory.yaml
-rw-r--r--. 1 root          root 56298 Apr 25 02:00 octavia-ansible.log

./overcloud-deploy/overcloud/config-download/overcloud/octavia-ansible/group_vars:                                                                           
total 4
-rw-r--r--. 1 root root 1557 Apr 25 01:56 octavia_vars.yaml
[stack@undercloud-0 ~]$ 
~~~ 

Version-Release number of selected component (if applicable):
OSP17 with 17.0_20220411.2_9 compose

How reproducible:
100%

Steps to Reproduce:
1. Deploy overcloud with Octavia
2. Try to delete the overcloud
3.

Actual results:
Deletion failed with permission denied error

Expected results:
Deletion should be successful


Additional info:

Comment 2 David Rosenfeld 2022-06-17 19:18:11 UTC

Deployed overcloud with octavia. After that delete is successful:

(undercloud) [stack@undercloud-0 ~]$ ll ./overcloud-deploy/overcloud/config-download/overcloud/ -R | grep octavia
drwxr-xr-x. 3 tripleo-admin root     73 Jun 17 18:36 octavia-ansible
./overcloud-deploy/overcloud/config-download/overcloud/octavia-ansible:
-rw-r--r--. 1 root          root 37564 Jun 17 18:36 octavia-ansible.log
./overcloud-deploy/overcloud/config-download/overcloud/octavia-ansible/group_vars:
-rw-r--r--. 1 root root 1556 Jun 17 18:31 octavia_vars.yaml
(undercloud) [stack@undercloud-0 ~]$ 
(undercloud) [stack@undercloud-0 ~]$ 
(undercloud) [stack@undercloud-0 ~]$ 
(undercloud) [stack@undercloud-0 ~]$ openstack overcloud delete overcloud
/usr/lib/python3.9/site-packages/ansible/_vendor/__init__.py:42: UserWarning: One or more Python packages bundled by this ansible-core distribution were already loaded (pyparsing). This may result in undefined behavior.
  warnings.warn('One or more Python packages bundled by this ansible-core distribution were already '
Are you sure you want to delete this overcloud [y/N]? y
[DEPRECATION WARNING]: ANSIBLE_CALLBACK_WHITELIST option, normalizing names to 
new standard, use ANSIBLE_CALLBACKS_ENABLED instead. This feature will be 
removed from ansible-core in version 2.15. Deprecation warnings can be disabled
 by setting deprecation_warnings=False in ansible.cfg.

PLAY [delete ipa entries for overcloud nodes] **********************************
2022-06-17 19:15:26.871825 | 5254006b-abe1-61d5-d87a-00000000000e |       TASK | Check if undercloud is an ipa client
2022-06-17 19:15:27.223692 | 5254006b-abe1-61d5-d87a-00000000000e |         OK | Check if undercloud is an ipa client | localhost
2022-06-17 19:15:27.224866 | 5254006b-abe1-61d5-d87a-00000000000e |     TIMING | Check if undercloud is an ipa client | localhost | 0:00:00.394088 | 0.35s
2022-06-17 19:15:27.230034 | 5254006b-abe1-61d5-d87a-00000000000f |       TASK | End play if undercloud is not an ipa client

PLAY [Overcloud Delete] ********************************************************
2022-06-17 19:15:27.249679 | 5254006b-abe1-61d5-d87a-00000000001a |       TASK | Check for required inputs
2022-06-17 19:15:27.282568 | 5254006b-abe1-61d5-d87a-00000000001a |    SKIPPED | Check for required inputs | localhost | item=stack_name
2022-06-17 19:15:27.284852 | 5254006b-abe1-61d5-d87a-00000000001a |     TIMING | Check for required inputs | localhost | 0:00:00.454077 | 0.03s
2022-06-17 19:15:27.289921 | 5254006b-abe1-61d5-d87a-00000000001b |       TASK | Set overcloud_deploy_path
2022-06-17 19:15:27.324891 | 5254006b-abe1-61d5-d87a-00000000001b |         OK | Set overcloud_deploy_path | localhost
2022-06-17 19:15:27.325788 | 5254006b-abe1-61d5-d87a-00000000001b |     TIMING | Set overcloud_deploy_path | localhost | 0:00:00.495012 | 0.03s
2022-06-17 19:15:27.330318 | 5254006b-abe1-61d5-d87a-00000000001c |       TASK | Set config_download_path
2022-06-17 19:15:27.365710 | 5254006b-abe1-61d5-d87a-00000000001c |         OK | Set config_download_path | localhost
2022-06-17 19:15:27.366610 | 5254006b-abe1-61d5-d87a-00000000001c |     TIMING | Set config_download_path | localhost | 0:00:00.535833 | 0.04s
2022-06-17 19:15:27.374551 | 5254006b-abe1-61d5-d87a-000000000020 |       TASK | Delete service vips used
2022-06-17 19:15:29.983631 | 5254006b-abe1-61d5-d87a-000000000020 |    CHANGED | Delete service vips used | localhost
2022-06-17 19:15:29.985618 | 5254006b-abe1-61d5-d87a-000000000020 |     TIMING | Delete service vips used | localhost | 0:00:03.154829 | 2.61s
2022-06-17 19:15:29.991807 | 5254006b-abe1-61d5-d87a-000000000021 |       TASK | Delete OVN MAC Address ports
2022-06-17 19:15:33.318864 | 5254006b-abe1-61d5-d87a-000000000021 |    CHANGED | Delete OVN MAC Address ports | localhost
2022-06-17 19:15:33.320003 | 5254006b-abe1-61d5-d87a-000000000021 |     TIMING | Delete OVN MAC Address ports | localhost | 0:00:06.489228 | 3.33s
2022-06-17 19:15:33.325483 | 5254006b-abe1-61d5-d87a-000000000022 |       TASK | Delete heat stack
2022-06-17 19:15:33.361133 | 5254006b-abe1-61d5-d87a-000000000022 |    SKIPPED | Delete heat stack | localhost
2022-06-17 19:15:33.362388 | 5254006b-abe1-61d5-d87a-000000000022 |     TIMING | Delete heat stack | localhost | 0:00:06.531611 | 0.04s
2022-06-17 19:15:33.367781 | 5254006b-abe1-61d5-d87a-000000000023 |       TASK | Remove the config download stack
2022-06-17 19:15:33.759324 | 5254006b-abe1-61d5-d87a-000000000023 |    CHANGED | Remove the config download stack | localhost
2022-06-17 19:15:33.760554 | 5254006b-abe1-61d5-d87a-000000000023 |     TIMING | Remove the config download stack | localhost | 0:00:06.929766 | 0.39s
2022-06-17 19:15:33.766217 | 5254006b-abe1-61d5-d87a-000000000024 |       TASK | Remove the deploy stack
2022-06-17 19:15:34.180986 | 5254006b-abe1-61d5-d87a-000000000024 |    CHANGED | Remove the deploy stack | localhost
2022-06-17 19:15:34.184277 | 5254006b-abe1-61d5-d87a-000000000024 |     TIMING | Remove the deploy stack | localhost | 0:00:07.353502 | 0.42s
2022-06-17 19:15:34.192538 | 5254006b-abe1-61d5-d87a-000000000025 |       TASK | Delete overcloud network Virtual IPs
2022-06-17 19:15:38.657066 | 5254006b-abe1-61d5-d87a-000000000025 |         OK | Delete overcloud network Virtual IPs | localhost
2022-06-17 19:15:38.658606 | 5254006b-abe1-61d5-d87a-000000000025 |     TIMING | Delete overcloud network Virtual IPs | localhost | 0:00:11.827817 | 4.47s
2022-06-17 19:15:38.667630 | 5254006b-abe1-61d5-d87a-00000000001e |       TASK | Workflow notice
2022-06-17 19:15:38.702903 | 5254006b-abe1-61d5-d87a-00000000001e |         OK | Workflow notice | localhost | result={
    "changed": false,
    "msg": "Ansible workflow completed."
}
2022-06-17 19:15:38.703791 | 5254006b-abe1-61d5-d87a-00000000001e |     TIMING | Workflow notice | localhost | 0:00:11.873002 | 0.04s

PLAY RECAP *********************************************************************
localhost                  : ok=9    changed=4    unreachable=0    failed=0    skipped=2    rescued=0    ignored=0   
2022-06-17 19:15:38.710632 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Summary Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2022-06-17 19:15:38.711223 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Total Tasks: 11         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2022-06-17 19:15:38.711730 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Elapsed Time: 0:00:11.880965 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2022-06-17 19:15:38.712285 |                                 UUID |       Info |       Host |   Task Name |   Run Time
2022-06-17 19:15:38.712868 | 5254006b-abe1-61d5-d87a-000000000025 |    SUMMARY |  localhost | Delete overcloud network Virtual IPs | 4.47s
2022-06-17 19:15:38.713450 | 5254006b-abe1-61d5-d87a-000000000021 |    SUMMARY |  localhost | Delete OVN MAC Address ports | 3.33s
2022-06-17 19:15:38.714021 | 5254006b-abe1-61d5-d87a-000000000020 |    SUMMARY |  localhost | Delete service vips used | 2.61s
2022-06-17 19:15:38.714541 | 5254006b-abe1-61d5-d87a-000000000024 |    SUMMARY |  localhost | Remove the deploy stack | 0.42s
2022-06-17 19:15:38.715018 | 5254006b-abe1-61d5-d87a-000000000023 |    SUMMARY |  localhost | Remove the config download stack | 0.39s
2022-06-17 19:15:38.715559 | 5254006b-abe1-61d5-d87a-00000000000e |    SUMMARY |  localhost | Check if undercloud is an ipa client | 0.35s
2022-06-17 19:15:38.716081 | 5254006b-abe1-61d5-d87a-000000000022 |    SUMMARY |  localhost | Delete heat stack | 0.04s
2022-06-17 19:15:38.716576 | 5254006b-abe1-61d5-d87a-00000000001c |    SUMMARY |  localhost | Set config_download_path | 0.04s
2022-06-17 19:15:38.717138 | 5254006b-abe1-61d5-d87a-00000000001e |    SUMMARY |  localhost | Workflow notice | 0.04s
2022-06-17 19:15:38.717665 | 5254006b-abe1-61d5-d87a-00000000001b |    SUMMARY |  localhost | Set overcloud_deploy_path | 0.03s
2022-06-17 19:15:38.718104 | 5254006b-abe1-61d5-d87a-00000000001a |    SUMMARY |  localhost | Check for required inputs | 0.03s
2022-06-17 19:15:38.718566 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ End Summary Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Success.
(undercloud) [stack@undercloud-0 ~]$

Comment 6 errata-xmlrpc 2022-09-21 12:20:53 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Release of components for Red Hat OpenStack Platform 17.0 (Wallaby)), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2022:6543

Note You need to log in before you can comment on or make changes to this bug.