Bug 1840125

Summary:	Random failures in test_amphora_list_and_show
Product:	Red Hat OpenStack	Reporter:	Carlos Goncalves <cgoncalves>
Component:	python-octavia-tests-tempest	Assignee:	Carlos Goncalves <cgoncalves>
Status:	CLOSED CURRENTRELEASE	QA Contact:	Bruna Bonguardo <bbonguar>
Severity:	low	Docs Contact:
Priority:	medium
Version:	16.0 (Train)	CC:	afazekas, bbonguar, michjohn
Target Milestone:	async	Keywords:	Triaged, ZStream
Target Release:	16.0 (Train on RHEL 8.1)
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:	1803779	Environment:
Last Closed:	2020-07-27 08:12:07 UTC	Type:	---
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:	1840108
Bug Blocks:

Description Carlos Goncalves 2020-05-26 12:12:18 UTC

+++ This bug was initially created as a clone of Bug #1803779 +++

Downstream CI warns for occasional failures in test octavia_tempest_plugin.tests.scenario.v2.test_amphora.AmphoraScenarioTest.test_amphora_list_and_show. The test failure is observed when multiple Octavia tests are run concurrently. The tracebacks can be distinct on multiple runs but are always at the same assert.

The test gets a list of amphorae in [1] and later in [2] it tests all of the fields from the amphora list match those from a show. In-between these two, there are other tests running that create/update/delete amphorae.

[1] https://github.com/openstack/octavia-tempest-plugin/blob/bbddf4b78d2bfe0ae15dc0d0826a11162a882fe9/octavia_tempest_plugin/tests/scenario/v2/test_amphora.py#L122
[2] https://github.com/openstack/octavia-tempest-plugin/blob/bbddf4b78d2bfe0ae15dc0d0826a11162a882fe9/octavia_tempest_plugin/tests/scenario/v2/test_amphora.py#L174-L175


Version-Release number of selected component (if applicable):
OSP 13+


Steps to Reproduce:
1. Deploy OSP 13+
2. Configure Tempest to run tests concurrently (say --threads 8)
3. Run Octavia tempest tests


Actual results:

One traceback (OSP 13):

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/octavia_tempest_plugin/tests/scenario/v2/test_amphora.py", line 175, in test_amphora_list_and_show
    self.assertEqual(amp[field], amp_obj[field])
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 350, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 435, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: None != u'10.1.1.5'

Another traceback (OSP 15):

Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/octavia_tempest_plugin/tests/scenario/v2/test_amphora.py", line 175, in test_amphora_list_and_show
    self.assertEqual(amp[field], amp_obj[field])
  File "/usr/lib/python3.6/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python3.6/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: None != 'b2b2eefd-dae4-4ea5-84c0-005fd47a0d41'

Comment 5 Carlos Goncalves 2020-07-27 08:12:07 UTC

Fix included in OSP 16.1 (bug #1840108).