Bug 1840132 - Random failures in test_amphora_list_and_show
Summary: Random failures in test_amphora_list_and_show
Keywords:
Status: CLOSED EOL
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: python-octavia-tests-tempest
Version: 15.0 (Stein)
Hardware: Unspecified
OS: Unspecified
medium
low
Target Milestone: z3
: 15.0 (Stein)
Assignee: Carlos Goncalves
QA Contact: Bruna Bonguardo
URL:
Whiteboard:
Depends On: 1840108
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-05-26 12:45 UTC by Carlos Goncalves
Modified: 2020-09-30 19:48 UTC (History)
4 users (show)

Fixed In Version: python-octavia-tests-tempest-1.1.1-0.20190826060431.7140479.el8ost
Doc Type: If docs needed, set a value
Doc Text:
Clone Of: 1803779
Environment:
Last Closed: 2020-09-30 19:48:09 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
OpenStack gerrit 711316 0 None MERGED Fix amphora list-show to run in a busy environment 2020-09-30 19:47:03 UTC

Description Carlos Goncalves 2020-05-26 12:45:03 UTC
+++ This bug was initially created as a clone of Bug #1803779 +++

Downstream CI warns for occasional failures in test octavia_tempest_plugin.tests.scenario.v2.test_amphora.AmphoraScenarioTest.test_amphora_list_and_show. The test failure is observed when multiple Octavia tests are run concurrently. The tracebacks can be distinct on multiple runs but are always at the same assert.

The test gets a list of amphorae in [1] and later in [2] it tests all of the fields from the amphora list match those from a show. In-between these two, there are other tests running that create/update/delete amphorae.

[1] https://github.com/openstack/octavia-tempest-plugin/blob/bbddf4b78d2bfe0ae15dc0d0826a11162a882fe9/octavia_tempest_plugin/tests/scenario/v2/test_amphora.py#L122
[2] https://github.com/openstack/octavia-tempest-plugin/blob/bbddf4b78d2bfe0ae15dc0d0826a11162a882fe9/octavia_tempest_plugin/tests/scenario/v2/test_amphora.py#L174-L175


Version-Release number of selected component (if applicable):
OSP 13+


Steps to Reproduce:
1. Deploy OSP 13+
2. Configure Tempest to run tests concurrently (say --threads 8)
3. Run Octavia tempest tests


Actual results:

One traceback (OSP 13):

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/octavia_tempest_plugin/tests/scenario/v2/test_amphora.py", line 175, in test_amphora_list_and_show
    self.assertEqual(amp[field], amp_obj[field])
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 350, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 435, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: None != u'10.1.1.5'

Another traceback (OSP 15):

Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/octavia_tempest_plugin/tests/scenario/v2/test_amphora.py", line 175, in test_amphora_list_and_show
    self.assertEqual(amp[field], amp_obj[field])
  File "/usr/lib/python3.6/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python3.6/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: None != 'b2b2eefd-dae4-4ea5-84c0-005fd47a0d41'

Comment 4 stchen 2020-09-30 19:48:09 UTC
Closing EOL, OSP 15 has been retired as of Sept 19, 2020


Note You need to log in before you can comment on or make changes to this bug.