Bug 1803779 - Random failures in test_amphora_list_and_show
Summary: Random failures in test_amphora_list_and_show
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: python-octavia-tests-tempest
Version: 13.0 (Queens)
Hardware: Unspecified
OS: Unspecified
medium
low
Target Milestone: z13
: 13.0 (Queens)
Assignee: Carlos Goncalves
QA Contact: Bruna Bonguardo
URL:
Whiteboard:
: 1824678 (view as bug list)
Depends On: 1840108
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-02-17 12:50 UTC by Carlos Goncalves
Modified: 2020-10-28 18:27 UTC (History)
2 users (show)

Fixed In Version: python-octavia-tests-tempest-1.1.0-2.el7ost
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
: 1840108 1840125 1840132 (view as bug list)
Environment:
Last Closed: 2020-10-28 18:26:57 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
OpenStack Storyboard 2007389 0 None None None 2020-03-06 09:30:06 UTC
OpenStack gerrit 711316 0 None MERGED Fix amphora list-show to run in a busy environment 2021-01-25 15:01:02 UTC
Red Hat Product Errata RHBA-2020:4387 0 None None None 2020-10-28 18:27:38 UTC

Description Carlos Goncalves 2020-02-17 12:50:09 UTC
Downstream CI warns for occasional failures in test octavia_tempest_plugin.tests.scenario.v2.test_amphora.AmphoraScenarioTest.test_amphora_list_and_show. The test failure is observed when multiple Octavia tests are run concurrently. The tracebacks can be distinct on multiple runs but are always at the same assert.

The test gets a list of amphorae in [1] and later in [2] it tests all of the fields from the amphora list match those from a show. In-between these two, there are other tests running that create/update/delete amphorae.

[1] https://github.com/openstack/octavia-tempest-plugin/blob/bbddf4b78d2bfe0ae15dc0d0826a11162a882fe9/octavia_tempest_plugin/tests/scenario/v2/test_amphora.py#L122
[2] https://github.com/openstack/octavia-tempest-plugin/blob/bbddf4b78d2bfe0ae15dc0d0826a11162a882fe9/octavia_tempest_plugin/tests/scenario/v2/test_amphora.py#L174-L175


Version-Release number of selected component (if applicable):
OSP 13+


Steps to Reproduce:
1. Deploy OSP 13+
2. Configure Tempest to run tests concurrently (say --threads 8)
3. Run Octavia tempest tests


Actual results:

One traceback (OSP 13):

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/octavia_tempest_plugin/tests/scenario/v2/test_amphora.py", line 175, in test_amphora_list_and_show
    self.assertEqual(amp[field], amp_obj[field])
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 350, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 435, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: None != u'10.1.1.5'

Another traceback (OSP 15):

Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/octavia_tempest_plugin/tests/scenario/v2/test_amphora.py", line 175, in test_amphora_list_and_show
    self.assertEqual(amp[field], amp_obj[field])
  File "/usr/lib/python3.6/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python3.6/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: None != 'b2b2eefd-dae4-4ea5-84c0-005fd47a0d41'

Comment 5 Carlos Goncalves 2020-04-17 14:37:05 UTC
*** Bug 1824678 has been marked as a duplicate of this bug. ***

Comment 18 errata-xmlrpc 2020-10-28 18:26:57 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat OpenStack Platform 13 bug fix and enhancement advisory), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:4387


Note You need to log in before you can comment on or make changes to this bug.