Bug 1840108 - Random failures in test_amphora_list_and_show
Summary: Random failures in test_amphora_list_and_show
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: python-octavia-tests-tempest
Version: 16.1 (Train)
Hardware: Unspecified
OS: Unspecified
medium
low
Target Milestone: beta
: 16.1 (Train on RHEL 8.2)
Assignee: Carlos Goncalves
QA Contact: Bruna Bonguardo
URL:
Whiteboard:
Depends On:
Blocks: 1803779 1840125 1840132
TreeView+ depends on / blocked
 
Reported: 2020-05-26 11:37 UTC by Carlos Goncalves
Modified: 2020-07-29 07:53 UTC (History)
3 users (show)

Fixed In Version: python-octavia-tests-tempest-1.3.0-0.20200506133435.0ae7f10.el8ost
Doc Type: If docs needed, set a value
Doc Text:
Clone Of: 1803779
Environment:
Last Closed: 2020-07-29 07:52:55 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
OpenStack gerrit 711316 0 None MERGED Fix amphora list-show to run in a busy environment 2020-07-27 08:10:28 UTC
Red Hat Product Errata RHBA-2020:3148 0 None None None 2020-07-29 07:53:16 UTC

Description Carlos Goncalves 2020-05-26 11:37:34 UTC
+++ This bug was initially created as a clone of Bug #1803779 +++

Downstream CI warns for occasional failures in test octavia_tempest_plugin.tests.scenario.v2.test_amphora.AmphoraScenarioTest.test_amphora_list_and_show. The test failure is observed when multiple Octavia tests are run concurrently. The tracebacks can be distinct on multiple runs but are always at the same assert.

The test gets a list of amphorae in [1] and later in [2] it tests all of the fields from the amphora list match those from a show. In-between these two, there are other tests running that create/update/delete amphorae.

[1] https://github.com/openstack/octavia-tempest-plugin/blob/bbddf4b78d2bfe0ae15dc0d0826a11162a882fe9/octavia_tempest_plugin/tests/scenario/v2/test_amphora.py#L122
[2] https://github.com/openstack/octavia-tempest-plugin/blob/bbddf4b78d2bfe0ae15dc0d0826a11162a882fe9/octavia_tempest_plugin/tests/scenario/v2/test_amphora.py#L174-L175


Version-Release number of selected component (if applicable):
OSP 13+


Steps to Reproduce:
1. Deploy OSP 13+
2. Configure Tempest to run tests concurrently (say --threads 8)
3. Run Octavia tempest tests


Actual results:

One traceback (OSP 13):

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/octavia_tempest_plugin/tests/scenario/v2/test_amphora.py", line 175, in test_amphora_list_and_show
    self.assertEqual(amp[field], amp_obj[field])
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 350, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 435, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: None != u'10.1.1.5'

Another traceback (OSP 15):

Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/octavia_tempest_plugin/tests/scenario/v2/test_amphora.py", line 175, in test_amphora_list_and_show
    self.assertEqual(amp[field], amp_obj[field])
  File "/usr/lib/python3.6/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python3.6/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: None != 'b2b2eefd-dae4-4ea5-84c0-005fd47a0d41'

Comment 8 errata-xmlrpc 2020-07-29 07:52:55 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:3148


Note You need to log in before you can comment on or make changes to this bug.