Bug 1907965 - Tests in octavia_tempest_plugin.tests.api.v2.test_pool.PoolAPITest fail with pool update timeout
Summary: Tests in octavia_tempest_plugin.tests.api.v2.test_pool.PoolAPITest fail with ...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-octavia
Version: 16.1 (Train)
Hardware: Unspecified
OS: Unspecified
medium
medium
Target Milestone: z9
: 16.1 (Train on RHEL 8.2)
Assignee: Gregory Thiemonge
QA Contact: Bruna Bonguardo
URL:
Whiteboard:
: 1961597 (view as bug list)
Depends On: 1975790 1976826
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-12-15 15:28 UTC by Arieh Maron
Modified: 2022-12-07 20:25 UTC (History)
5 users (show)

Fixed In Version: openstack-octavia-5.0.3-1.20220216175316.8c32d2e.el8ost
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2022-12-07 20:24:45 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
OpenStack Storyboard 2007984 0 None None None 2021-02-01 10:22:03 UTC
OpenStack gerrit 757841 0 None MERGED Fix pool delete race on load balancer cascade delete 2022-01-26 09:48:24 UTC
OpenStack gerrit 770175 0 None MERGED Fix operating status for empty UDP pools 2022-01-26 09:48:11 UTC
Red Hat Issue Tracker OSP-1569 0 None None None 2022-01-24 09:33:11 UTC
Red Hat Product Errata RHBA-2022:8795 0 None None None 2022-12-07 20:25:37 UTC

Description Arieh Maron 2020-12-15 15:28:00 UTC
Description of problem:

Tests in octavia_tempest_plugin.tests.api.v2.test_pool.PoolAPITest.test_UDP_**_pool_create fail with pool update timeout 
The test runs fail with the error:

Traceback (most recent call last):
  File "/home/stack/plugins/octavia/octavia_tempest_plugin/tests/api/v2/test_pool.py", line 238, in test_UDP_SI_pool_with_listener_create
    algorithm=const.LB_ALGORITHM_SOURCE_IP)
  File "/home/stack/plugins/octavia/octavia_tempest_plugin/tests/api/v2/test_pool.py", line 445, in _test_pool_create
    CONF.load_balancer.build_timeout)
  File "/home/stack/plugins/octavia/octavia_tempest_plugin/tests/waiters.py", line 96, in wait_for_status
    raise exceptions.TimeoutException(message)
tempest.lib.exceptions.TimeoutException: Request timed out
Details: (PoolAPITest:test_UDP_SI_pool_with_listener_create) show_pool operating_status failed to update to ONLINE within the required time 300. Current status of show_pool: OFFLINE



Version-Release number of selected component (if applicable):

16.1 (Train) 13 (Queen)

How reproducible:

100%


Steps to Reproduce:

1. python3 testtools.run octavia_tempest_plugin.tests.api.v2.test_pool.PoolAPITest.test_UDP_**_pool_create  (** can be LC or RR)

Actual results:

Traceback (most recent call last):
  File "/home/stack/plugins/octavia/octavia_tempest_plugin/tests/api/v2/test_pool.py", line 238, in test_UDP_SI_pool_with_listener_create
    algorithm=const.LB_ALGORITHM_SOURCE_IP)
  File "/home/stack/plugins/octavia/octavia_tempest_plugin/tests/api/v2/test_pool.py", line 445, in _test_pool_create
    CONF.load_balancer.build_timeout)
  File "/home/stack/plugins/octavia/octavia_tempest_plugin/tests/waiters.py", line 96, in wait_for_status
    raise exceptions.TimeoutException(message)
tempest.lib.exceptions.TimeoutException: Request timed out
Details: (PoolAPITest:test_UDP_SI_pool_with_listener_create) show_pool operating_status failed to update to ONLINE within the required time 300. Current status of show_pool: OFFLINE




Expected results:

Successful run

Additional info:

Comment 1 Gregory Thiemonge 2020-12-16 10:11:01 UTC

*** This bug has been marked as a duplicate of bug 1907788 ***

Comment 4 Gregory Thiemonge 2021-02-01 10:21:15 UTC
Was closed by mistake, the issue still affects 16.1

Comment 5 Bruna Bonguardo 2021-06-09 11:54:27 UTC
*** Bug 1961597 has been marked as a duplicate of this bug. ***

Comment 6 Bruna Bonguardo 2021-06-09 11:55:45 UTC
Greg's comment from https://bugzilla.redhat.com/show_bug.cgi?id=1961597#c1 :

Pool deletion timed out because of a lost of connectivity between the octavia services and the amphora:

2021-05-09 13:01:25.590 31 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-b97ab21c-dd6e-4484-8b2d-e502b9073c43 - 62a072e951cb40c78122401fe79b9668 - - -] Could not connect to instance. Retrying.: requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='172.24.1.139', port=9443): Read timed out. (read timeout=60.0)
2021-05-09 13:01:40.615 31 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-b97ab21c-dd6e-4484-8b2d-e502b9073c43 - 62a072e951cb40c78122401fe79b9668 - - -] Could not connect to instance. Retrying.: requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='172.24.1.139', port=9443): Read timed out. (read timeout=10.0)
2021-05-09 13:01:55.634 31 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-b97ab21c-dd6e-4484-8b2d-e502b9073c43 - 62a072e951cb40c78122401fe79b9668 - - -] Could not connect to instance. Retrying.: requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='172.24.1.139', port=9443): Read timed out. (read timeout=10.0)

Comment 7 Gregory Thiemonge 2021-06-25 06:54:29 UTC
I believe the issue is related to BZ 1975790

Fixing 1975790 would fix the CI jobs

Comment 8 Gregory Thiemonge 2021-07-21 08:56:46 UTC
Note: This BZ can be set as VERIFIED when BZ 1975790 is VERIFIED

Comment 9 Gregory Thiemonge 2021-07-22 10:21:11 UTC
now ON_QA as the "Depends On" BZ is ON_QA

Comment 10 Bruna Bonguardo 2021-07-22 10:33:34 UTC
Bug cannot be verified until 16.1 z7 puddle is available.

Comment 27 errata-xmlrpc 2022-12-07 20:24:45 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat OpenStack Platform 16.1.9 bug fix and enhancement advisory), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2022:8795


Note You need to log in before you can comment on or make changes to this bug.