Bug 2074474

Summary: Amphora log offloading directory octavia-amphorae is empty
Product: Red Hat OpenStack Reporter: Omer Schwartz <oschwart>
Component: openstack-octaviaAssignee: Gregory Thiemonge <gthiemon>
Status: CLOSED ERRATA QA Contact: Omer Schwartz <oschwart>
Severity: medium Docs Contact:
Priority: medium    
Version: 17.0 (Wallaby)CC: chrisbro, gthiemon, ihrachys, lpeer, majopela, scohen
Target Milestone: zstreamKeywords: Triaged
Target Release: 17.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: openstack-octavia-8.0.2-0.20221121160846.3b2f562.el9ost Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2023-01-25 12:28:47 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Omer Schwartz 2022-04-12 10:10:09 UTC
Description of problem:
After deploying amphora log offloading, the Amphora log offloading directory in the controller (octavia-amphorae) is empty.

We can see on there is no octavia-amphorae directory here
http://rhos-ci-logs.lab.eng.tlv2.redhat.com/logs/rcj/DFG-network-octavia-17.0_director-rhel-virthost-3cont_3comp-ipv4-geneve-actstby/28/controller-0/var/log/containers/
Because the Jenkins UI does not show empty directories, but manually I saw that the directory exists and is empty.


Version-Release number of selected component (if applicable):
[stack@undercloud-0 ~]$ cat /etc/rhosp-release 
Red Hat OpenStack Platform release 17.0.0 Beta (Wallaby)

How reproducible:
100%

Steps to Reproduce:
1. Run Octavia Active standby job for OSP17 (which deploy Amphora log offloading by default).

Actual results:
No logs in Controller-0/var/log/containers/octavia-amphorae directory.

Expected results:
The Amphora offloaded logs are supposed to be there.

Comment 12 Omer Schwartz 2022-12-13 10:16:32 UTC
Verification steps of RHOS-17.0-RHEL-9-20221206.n.0 with openstack-octavia-8.0.2-0.20221121160846.3b2f562.el9ost:


# Making sure rsyslog container is up and running

(overcloud) [stack@undercloud-0 ~]$ ssh controller-0.ctlplane sudo podman ps | grep rsyslog
Warning: Permanently added 'controller-0.ctlplane' (ED25519) to the list of known hosts.
26ff878f29eb  undercloud-0.ctlplane.redhat.local:8787/rh-osbs/rhosp17-openstack-rsyslog:17.0_20221205.1                 kolla_start           17 hours ago  Up 17 hours ago                        octavia_rsyslog




# Creating an LB

(overcloud) [stack@undercloud-0 ~]$ openstack loadbalancer create --vip-subnet-id private-subnet --name lb1
/usr/lib/python3.9/site-packages/osc_lib/utils/__init__.py:448: DeprecationWarning: The usage of formatter functions is now discouraged. Consider using cliff.columns.FormattableColumn instead. See reviews linked with bug 1687955 for more detail.
  warnings.warn(
+---------------------+--------------------------------------+
| Field               | Value                                |
+---------------------+--------------------------------------+
| admin_state_up      | True                                 |
| availability_zone   | None                                 |
| created_at          | 2022-12-13T10:06:30                  |
| description         |                                      |
| flavor_id           | None                                 |
| id                  | 8f29951f-664f-45af-b8a3-bbe000e69436 |
| listeners           |                                      |
| name                | lb1                                  |
| operating_status    | OFFLINE                              |
| pools               |                                      |
| project_id          | 7f814b93605643f782c96fc7cdf4e9e7     |
| provider            | amphora                              |
| provisioning_status | PENDING_CREATE                       |
| updated_at          | None                                 |
| vip_address         | 10.0.64.5                            |
| vip_network_id      | e0fea556-c62e-4dcd-87c7-46a8ba88b7df |
| vip_port_id         | df93474a-b012-41b0-991c-a1bb2b101feb |
| vip_qos_policy_id   | None                                 |
| vip_subnet_id       | 28cb8d13-a9a1-4026-b456-b8e1e6e99453 |
| tags                |                                      |
+---------------------+--------------------------------------+


# LB is active
(overcloud) [stack@undercloud-0 ~]$ openstack loadbalancer list
+--------------------------------------+------+----------------------------------+-------------+---------------------+------------------+----------+
| id                                   | name | project_id                       | vip_address | provisioning_status | operating_status | provider |
+--------------------------------------+------+----------------------------------+-------------+---------------------+------------------+----------+
| 8f29951f-664f-45af-b8a3-bbe000e69436 | lb1  | 7f814b93605643f782c96fc7cdf4e9e7 | 10.0.64.5   | ACTIVE              | ONLINE           | amphora  |
+--------------------------------------+------+----------------------------------+-------------+---------------------+------------------+----------+


# Making sure the /var/log/containers/octavia-amphorae directory is not empty
(overcloud) [stack@undercloud-0 ~]$ ssh controller-0.ctlplane sudo ls -la /var/log/containers/octavia-amphorae
Warning: Permanently added 'controller-0.ctlplane' (ED25519) to the list of known hosts.
total 52
drwxr-x---.  2 root root    33 Dec 13 10:07 .
drwxr-x---. 20 root root  4096 Dec 12 16:54 ..
-rw-r--r--.  1 root root 47608 Dec 13 10:08 octavia-amphora.log


Looks good to me. I am moving this BZ status to VERIFIED.

Comment 17 errata-xmlrpc 2023-01-25 12:28:47 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat OpenStack Platform 17.0.1 bug fix and enhancement advisory), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2023:0271