Bug 1840125 - Random failures in test_amphora_list_and_show
Summary: Random failures in test_amphora_list_and_show
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: python-octavia-tests-tempest
Version: 16.0 (Train)
Hardware: Unspecified
OS: Unspecified
medium
low
Target Milestone: async
: 16.0 (Train on RHEL 8.1)
Assignee: Carlos Goncalves
QA Contact: Bruna Bonguardo
URL:
Whiteboard:
Depends On: 1840108
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-05-26 12:12 UTC by Carlos Goncalves
Modified: 2020-07-27 08:12 UTC (History)
3 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of: 1803779
Environment:
Last Closed: 2020-07-27 08:12:07 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
OpenStack gerrit 711316 0 None MERGED Fix amphora list-show to run in a busy environment 2020-07-27 08:09:34 UTC

Description Carlos Goncalves 2020-05-26 12:12:18 UTC
+++ This bug was initially created as a clone of Bug #1803779 +++

Downstream CI warns for occasional failures in test octavia_tempest_plugin.tests.scenario.v2.test_amphora.AmphoraScenarioTest.test_amphora_list_and_show. The test failure is observed when multiple Octavia tests are run concurrently. The tracebacks can be distinct on multiple runs but are always at the same assert.

The test gets a list of amphorae in [1] and later in [2] it tests all of the fields from the amphora list match those from a show. In-between these two, there are other tests running that create/update/delete amphorae.

[1] https://github.com/openstack/octavia-tempest-plugin/blob/bbddf4b78d2bfe0ae15dc0d0826a11162a882fe9/octavia_tempest_plugin/tests/scenario/v2/test_amphora.py#L122
[2] https://github.com/openstack/octavia-tempest-plugin/blob/bbddf4b78d2bfe0ae15dc0d0826a11162a882fe9/octavia_tempest_plugin/tests/scenario/v2/test_amphora.py#L174-L175


Version-Release number of selected component (if applicable):
OSP 13+


Steps to Reproduce:
1. Deploy OSP 13+
2. Configure Tempest to run tests concurrently (say --threads 8)
3. Run Octavia tempest tests


Actual results:

One traceback (OSP 13):

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/octavia_tempest_plugin/tests/scenario/v2/test_amphora.py", line 175, in test_amphora_list_and_show
    self.assertEqual(amp[field], amp_obj[field])
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 350, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 435, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: None != u'10.1.1.5'

Another traceback (OSP 15):

Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/octavia_tempest_plugin/tests/scenario/v2/test_amphora.py", line 175, in test_amphora_list_and_show
    self.assertEqual(amp[field], amp_obj[field])
  File "/usr/lib/python3.6/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python3.6/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: None != 'b2b2eefd-dae4-4ea5-84c0-005fd47a0d41'

Comment 5 Carlos Goncalves 2020-07-27 08:12:07 UTC
Fix included in OSP 16.1 (bug #1840108).


Note You need to log in before you can comment on or make changes to this bug.