Bug 2050177

Summary: Protect vs unordered results in TrunkTestInheritJSONBase [backport ]
Product: Red Hat OpenStack Reporter: Eran Kuris <ekuris>
Component: python-neutron-tests-tempestAssignee: Eran Kuris <ekuris>
Status: CLOSED ERRATA QA Contact: Eran Kuris <ekuris>
Severity: medium Docs Contact:
Priority: high    
Version: 16.2 (Train)CC: egarciar
Target Milestone: z3Keywords: AutomationBlocker, Triaged
Target Release: 16.2 (Train on RHEL 8.4)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: python-neutron-tests-tempest-0.9.0-2.20220301095344.15c85f6 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2022-06-22 16:03:29 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Eran Kuris 2022-02-03 12:17:46 UTC
Description of problem:

Tested vs OpenStack master + OVN- from time to time the order is incorrect and it makes the test to be failed. 

Traceback (most recent call last):
  File "/usr/lib/python3.8/site-packages/neutron_tempest_plugin/api/test_trunk.py", line 238, in test_add_subport
    self.assertEqual(expected_subports, trunk['sub_ports'])
  File "/usr/lib/python3.8/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python3.8/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: !=:
reference = [{'port_id': '6eb624a9-368c-472c-a3ce-26608e77d2e7',
  'segmentation_id': 3,
  'segmentation_type': 'vlan'},
 {'port_id': '7a06845b-f379-4143-90f7-e664a8a602ec',
  'segmentation_id': 2,
  'segmentation_type': 'vlan'}]
actual = [{'port_id': '7a06845b-f379-4143-90f7-e664a8a602ec',
  'segmentation_id': 2,
  'segmentation_type': 'vlan'},
 {'port_id': '6eb624a9-368c-472c-a3ce-26608e77d2e7',
  'segmentation_id': 3,
  'segmentation_type': 'vlan'}]
Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

Comment 6 Eran Kuris 2022-05-03 15:05:08 UTC
All API trunk tests were passed:

https://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/view/DFG/view/network/view/networking-ovn/job/DFG-network-networking-ovn-16.2_director-rhel-virthost-3cont_2comp-ipv4-geneve-gate-ovn/213/testReport/neutron_tempest_plugin.api.test_trunk/TrunkTestJSON/

(overcloud) [stack@undercloud-0 tempest-dir]$ rpm -qa | grep neutron-tests-tempest-python3-neutron-tests-tempest-0.9.0-2.20220324225316.15c85f6.el8ost.noarch

(overcloud) [stack@undercloud-0 ~]$ cat core_puddle_version 
RHOS-16.2-RHEL-8-20220427.n.3

Comment 12 errata-xmlrpc 2022-06-22 16:03:29 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Release of components for Red Hat OpenStack Platform 16.2.3 (Train)), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2022:4793