Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 2209633

Summary: Tripleo Standalone jobs with ceph 6.0 failing with "msg": "JSONDecodeError: Expecting value: line 1 column 1 (char 0)"} and PermissionError: [Errno 13] Permission denied: '/var/lib/kolla/config_files/src-ceph/ceph.conf'
Product: Red Hat OpenStack Reporter: Sandeep Yadav <sandyada>
Component: tripleo-ansibleAssignee: Francesco Pantano <fpantano>
Status: CLOSED ERRATA QA Contact: Alfredo <alfrgarc>
Severity: urgent Docs Contact:
Priority: urgent    
Version: 17.1 (Wallaby)CC: apevec, fpan, fpantano, gfidente, johfulto, mkrcmari, pgrist, svyas
Target Milestone: rcKeywords: Triaged
Target Release: 17.1   
Hardware: x86_64   
OS: All   
Whiteboard:
Fixed In Version: tripleo-ansible-3.3.1-1.20230518201532.el9ost openstack-tripleo-heat-templates-14.3.1-1.20230519151005.el9ost Doc Type: No Doc Update
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2023-08-16 01:15:24 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Sandeep Yadav 2023-05-24 10:12:17 UTC
Description of problem:

Tripleo Standalone jobs with ceph 6.0 failing with "msg": "JSONDecodeError: Expecting value: line 1 column 1 (char 0)"} and PermissionError: [Errno 13] Permission denied: '/var/lib/kolla/config_files/src-ceph/ceph.conf'

Version-Release number of selected component (if applicable):
17.1 / Ceph6.0

How reproducible:
Everytime


Steps to Reproduce:
1. Deploy quickstart scenario 01/04/10 that have ceph


Actual results:

Deployment fails, seeing two different type of error:

1)Failure in sc001


In standalone logs:-

2023-05-23 13:57:11,324 p=77423 u=root n=ansible | 2023-05-23 13:57:11.323646 | fa163e52-89a4-815e-b463-000000002bcd |      FATAL | search triple_run_cephadm_output of cephadm run(s) non-zero return codes | undercloud | error={"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result"}

tripleo-deploy/standalone-ansible-b896udk9/cephadm/cephadm_command.log

2023-05-23 13:57:11,128 p=143961 u=root n=ansible | 2023-05-23 13:57:11.128369 | fa163e52-89a4-230f-2cb3-000000000185 |      FATAL | Save tripleo_ceph_client_vars file | standalone -> localhost | error={"changed": false, "msg": "JSONDecodeError: Expecting value: line 1 column 1 (char 0)"}

2) Failure in sc004/010

023-05-23 13:53:14.041804 |                                      |    WARNING | ERROR: Can't run container glance_api_db_sync
stderr: + sudo -E kolla_set_configs
sudo: unable to send audit message: Operation not permitted
INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json
INFO:__main__:Validating config file
INFO:__main__:Kolla config strategy set to: COPY_ALWAYS
INFO:__main__:Copying service configuration files
INFO:__main__:Deleting /etc/glance/glance-api.conf
INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/glance/glance-api.conf to /etc/glance/glance-api.conf
INFO:__main__:Deleting /etc/glance/glance-cache.conf
INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/glance/glance-cache.conf to /etc/glance/glance-cache.conf
INFO:__main__:Deleting /etc/glance/glance-image-import.conf
INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/glance/glance-image-import.conf to /etc/glance/glance-image-import.conf
INFO:__main__:Creating directory /etc/my.cnf.d
INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/my.cnf.d/tripleo.cnf to /etc/my.cnf.d/tripleo.cnf
INFO:__main__:Copying /var/lib/kolla/config_files/src/var/spool/cron/glance to /var/spool/cron/glance
INFO:__main__:Copying /var/lib/kolla/config_files/src-ceph/ceph.conf to /etc/ceph/ceph.conf
ERROR:__main__:Unable to merge /var/lib/kolla/config_files/src-ceph/ with /etc/ceph/
ERROR:__main__:Unexpected error:
Traceback (most recent call last):
  File "/usr/local/bin/kolla_set_configs", line 423, in main
    execute_config_strategy(config)
  File "/usr/local/bin/kolla_set_configs", line 390, in execute_config_strategy
    copy_config(config)
  File "/usr/local/bin/kolla_set_configs", line 313, in copy_config
    config_file.copy()
  File "/usr/local/bin/kolla_set_configs", line 151, in copy
    self._merge_directories(source, dest)
  File "/usr/local/bin/kolla_set_configs", line 96, in _merge_directories
    self._merge_directories(os.path.join(source, to_copy),
  File "/usr/local/bin/kolla_set_configs", line 99, in _merge_directories
    self._copy_file(source, dest)
  File "/usr/local/bin/kolla_set_configs", line 82, in _copy_file
    shutil.copy(source, dest)
  File "/usr/lib64/python3.9/shutil.py", line 427, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib64/python3.9/shutil.py", line 264, in copyfile
    with open(src, 'rb') as fsrc:
PermissionError: [Errno 13] Permission denied: '/var/lib/kolla/config_files/src-ceph/ceph.conf'


Expected results:

Tripleo deployment is working fine with ceph5, It should work with ceph6 without any permission issues.


Additional info:

We have recently switch from ceph5 to ceph6 and this is the first iteration.

Comment 39 errata-xmlrpc 2023-08-16 01:15:24 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Release of components for Red Hat OpenStack Platform 17.1 (Wallaby)), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2023:4577