Bug 2113846

Summary: ERROR: Can't run container ceilometer_gnocchi_upgrade
Product: Red Hat OpenStack Reporter: bshewale <bshewale>
Component: gnocchiAssignee: Yadnesh Kulkarni <ykulkarn>
Status: CLOSED ERRATA QA Contact: Leonid Natapov <lnatapov>
Severity: urgent Docs Contact:
Priority: high    
Version: 17.1 (Wallaby)CC: apevec, eduen, jjoyce, jschluet, lhh, lmadsen, mburns, mgarciac, mrunge, pojadhav, sandyada, shrjoshi, tkajinam, ykulkarn
Target Milestone: betaKeywords: Triaged
Target Release: 17.1   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: gnocchi-4.4.3-1.20220806080832.a07d82e.el9ost Doc Type: No Doc Update
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2023-08-16 01:11:24 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description bshewale@redhat.com 2022-08-02 06:53:14 UTC
Description of problem: ERROR: Can't run container ceilometer_gnocchi_upgrade


Version-Release number of selected component (if applicable): rhos17.1 on rhel9


Error log:

2022-08-01 12:22:12.220665 |                                      |    WARNING | ERROR: Can't run container ceilometer_gnocchi_upgrade
stderr: + sudo -E kolla_set_configs
sudo: unable to send audit message: Operation not permitted
INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json
INFO:__main__:Validating config file
INFO:__main__:Kolla config strategy set to: COPY_ALWAYS
INFO:__main__:Copying service configuration files
INFO:__main__:Deleting /etc/ceilometer/ceilometer.conf
INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/ceilometer/ceilometer.conf to /etc/ceilometer/ceilometer.conf
INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/ceilometer/event_pipeline.yaml to /etc/ceilometer/event_pipeline.yaml
INFO:__main__:Deleting /etc/ceilometer/pipeline.yaml
INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/ceilometer/pipeline.yaml to /etc/ceilometer/pipeline.yaml
INFO:__main__:Deleting /etc/ceilometer/polling.yaml
INFO:__main__:Copying /var/lib/kolla/config_files/src/etc/ceilometer/polling.yaml to /etc/ceilometer/polling.yaml
INFO:__main__:Writing out command to execute
++ cat /run_command
+ CMD='/usr/bin/bootstrap_host_exec ceilometer_agent_central su ceilometer -s /bin/bash -c '\''for n in {1..10}; do /usr/bin/ceilometer-upgrade && exit 0 || sleep 30; done; exit 1'\'''
+ ARGS=
+ [[ ! -n '' ]]
+ . kolla_extend_start
+ echo 'Running command: '\''/usr/bin/bootstrap_host_exec ceilometer_agent_central su ceilometer -s /bin/bash -c '\''for n in {1..10}; do /usr/bin/ceilometer-upgrade && exit 0 || sleep 30; done; exit 1'\'''\'''
+ exec /usr/bin/bootstrap_host_exec ceilometer_agent_central su ceilometer -s /bin/bash -c ''\''for' n in '{1..10};' do /usr/bin/ceilometer-upgrade '&&' exit 0 '||' sleep '30;' 'done;' exit '1'\'''
2022-08-01 12:22:12.227852 | fa163eaf-04bf-0c5a-cf55-000000004a83 |      FATAL | Create containers managed by Podman for /var/lib/tripleo-config/container-startup-config/step_5 | standalone | error={"changed": false, "msg": "Failed containers: ceilometer_gnocchi_upgrade"}
2022-08-01 12:22:12.232298 | fa163eaf-04bf-0c5a-cf55-000000004a83 |     TIMING | tripleo_container_manage : Create containers managed by Podman for /var/lib/tripleo-config/container-startup-config/step_5 | standalone | 0:36:51.682235 | 329.33s

PLAY RECAP *********************************************************************
localhost                  : ok=1    changed=0    unreachable=0    failed=0    skipped=2    rescued=0    ignored=0   
standalone                 : ok=635  changed=288  unreachable=0    failed=1    skipped=213  rescued=0    ignored=0   
undercloud                 : ok=192  changed=61   unreachable=0    failed=0    skipped=41   rescued=0    ignored=0   
2022-08-01 12:22:12.296821 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Summary Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2022-08-01 12:22:12.300599 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Total Tasks: 1112       ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2022-08-01 12:22:12.303644 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Elapsed Time: 0:36:51.753599 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Affected jobs:

1. sc001 on rhos17.1 on rhel9
2. sc002 on rhos17.1 on rhel9
3. sc010 on rhos17.1 on rhel9

Actual results: "Failed containers: ceilometer_gnocchi_upgrade"


Expected results: Standalone deployment should be successful without any failure.

Comment 14 Jon Schlueter 2022-08-08 14:54:16 UTC
based on patch and comments it should be fixed in this build gnocchi-4.4.3-1.20220806080832.a07d82e.el9osttrunk

Comment 19 Leonid Natapov 2023-02-20 05:13:33 UTC
RHOS-17.1-RHEL-9-20230131.n.2

gnocchi-api-4.4.3-1.20230121060819.d688f7c.el9ost.noarch


[root@controller-0 /]# gnocchi-api --version
4.4.3.dev37+gd688f7c0x§

Comment 27 errata-xmlrpc 2023-08-16 01:11:24 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Release of components for Red Hat OpenStack Platform 17.1 (Wallaby)), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2023:4577