Bug 1926251

Summary: UDP tests fail with "testtools.matchers._impl.MismatchError: 'NO_MONITOR' != 'ERROR'"
Product: Red Hat OpenStack Reporter: Gregory Thiemonge <gthiemon>
Component: openstack-octaviaAssignee: Gregory Thiemonge <gthiemon>
Status: CLOSED ERRATA QA Contact: Bruna Bonguardo <bbonguar>
Severity: medium Docs Contact:
Priority: medium    
Version: 16.1 (Train)CC: bbonguar, ihrachys, lpeer, majopela, oschwart, scohen
Target Milestone: z7Keywords: Triaged, ZStream
Target Release: 16.1 (Train on RHEL 8.2)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: openstack-octavia-5.0.3-1.20210625063307.el8ost Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: 1883239
: 1926254 (view as bug list) Environment:
Last Closed: 2021-12-09 20:18:00 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1883239    
Bug Blocks: 1926254    

Description Gregory Thiemonge 2021-02-08 13:58:31 UTC
+++ This bug was initially created as a clone of Bug #1883239 +++

octavia-tempest-plugin tests are failing in OSP16.1:

octavia_tempest_plugin.tests.api.v2.test_member.MemberAPITest:
* test_ipv6_UDP_LC_alt_monitor_member_create
* test_ipv6_UDP_RR_alt_monitor_member_create
* test_ipv6_UDP_RR_member_create
* test_ipv6_UDP_SI_alt_monitor_member_create
* test_ipv6_UDP_SI_member_create

with the error:

2020-09-28 07:41:27,192 32619 INFO     [tempest.lib.common.rest_client] Request (MemberAPITest:test_ipv6_UDP_RR_member_create): 200 GET http://10.0.0.136:9876/v2.0/lbaas/pools/0d70a9c2-30ce-47bf-9c4a-a98746e1a51a/members/0a59911e-01d7-4ac9-82fd-762b968648b4 1.949s
2020-09-28 07:41:27,192 32619 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'date': 'Mon, 28 Sep 2020 11:41:25 GMT', 'server': 'Apache', 'x-openstack-request-id': 'req-0c4e8f26-f353-4690-a004-dbb3927b0cd5', 'content-length': '588', 'vary': 'Accept-Encoding', 'connection': 'close', 'content-type': 'application/json', 'status': '200', 'content-location': 'http://10.0.0.136:9876/v2.0/lbaas/pools/0d70a9c2-30ce-47bf-9c4a-a98746e1a51a/members/0a59911e-01d7-4ac9-82fd-762b968648b4'}
        Body: b'{"member": {"monitor_port": null, "project_id": "0cb699e390b44409a1f7fd7efe4c3bd4", "name": "tempest-lb_member_member1-create-463936494", "weight": 50, "admin_state_up": true, "subnet_id": "7455bf67-2db8-4854-8af8-27e7b0522d13", "tenant_id": "0cb699e390b44409a1f7fd7efe4c3bd4", "created_at": "2020-09-28T11:40:52", "provisioning_status": "ACTIVE", "monitor_address": null, "updated_at": "2020-09-28T11:41:22", "tags": ["hello", "world"], "address": "2001:db8:0:0:0:0:0:1", "protocol_port": 8112, "backup": false, "id": "0a59911e-01d7-4ac9-82fd-762b968648b4", "operating_status": "ERROR"}}'
2020-09-28 07:41:27,192 32619 INFO     [octavia_tempest_plugin.tests.waiters] show_member's status updated to ACTIVE.
}}}

Traceback (most recent call last):
  File "/home/stack/.virtualenvs/.tempest/lib64/python3.6/site-packages/tempest/lib/decorators.py", line 88, in wrapper
    return f(*func_args, **func_kwargs)
  File "/home/stack/plugins/octavia/octavia_tempest_plugin/tests/api/v2/test_member.py", line 665, in test_ipv6_UDP_RR_member_create
    self._test_member_create(6, pool_id)
  File "/home/stack/plugins/octavia/octavia_tempest_plugin/tests/api/v2/test_member.py", line 925, in _test_member_create
    self.assertEqual(const.NO_MONITOR, member[const.OPERATING_STATUS])
  File "/home/stack/.virtualenvs/.tempest/lib64/python3.6/site-packages/testtools/testcase.py", line 415, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/home/stack/.virtualenvs/.tempest/lib64/python3.6/site-packages/testtools/testcase.py", line 502, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: 'NO_MONITOR' != 'ERROR'


Related fix: https://review.opendev.org/#/c/752872/

Comment 17 Omer Schwartz 2021-11-22 11:54:18 UTC
For many CI runs we could see that the following tests:

octavia_tempest_plugin.tests.api.v2.test_member.MemberAPITest:
* test_ipv6_UDP_LC_alt_monitor_member_create
* test_ipv6_UDP_RR_alt_monitor_member_create
* test_ipv6_UDP_RR_member_create
* test_ipv6_UDP_SI_alt_monitor_member_create
* test_ipv6_UDP_SI_member_create


Are passing.

E.g. on our last OSP16.1 Active standby run:
https://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/view/DFG/view/network/view/octavia/job/DFG-network-octavia-16.1_director-rhel-virthost-3cont_3comp-ipv4-geneve-actstby/26/


We could see that the mentioned tests pass:

https://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/view/DFG/view/network/view/octavia/job/DFG-network-octavia-16.1_director-rhel-virthost-3cont_3comp-ipv4-geneve-actstby/26/testReport/octavia_tempest_plugin.tests.api.v2.test_member/MemberAPITest/test_ipv6_UDP_LC_alt_monitor_member_create_id_0c2c2d5f_9602_4602_82e7_94a1393c295d_/

https://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/view/DFG/view/network/view/octavia/job/DFG-network-octavia-16.1_director-rhel-virthost-3cont_3comp-ipv4-geneve-actstby/26/testReport/octavia_tempest_plugin.tests.api.v2.test_member/MemberAPITest/test_ipv6_UDP_RR_alt_monitor_member_create_id_4cddcf8a_566e_4a5a_bf81_99026b17f676_/

https://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/view/DFG/view/network/view/octavia/job/DFG-network-octavia-16.1_director-rhel-virthost-3cont_3comp-ipv4-geneve-actstby/26/testReport/octavia_tempest_plugin.tests.api.v2.test_member/MemberAPITest/test_ipv6_UDP_RR_member_create_id_26547c9a_6bbc_429a_9436_e94f2930b9e1_/

https://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/view/DFG/view/network/view/octavia/job/DFG-network-octavia-16.1_director-rhel-virthost-3cont_3comp-ipv4-geneve-actstby/26/testReport/octavia_tempest_plugin.tests.api.v2.test_member/MemberAPITest/test_ipv6_UDP_SI_alt_monitor_member_create_id_ccfc1283_9e8e_4aa5_a5d3_1d18d57bec65_/

https://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/view/DFG/view/network/view/octavia/job/DFG-network-octavia-16.1_director-rhel-virthost-3cont_3comp-ipv4-geneve-actstby/26/testReport/octavia_tempest_plugin.tests.api.v2.test_member/MemberAPITest/test_ipv6_UDP_SI_member_create_id_b62c8562_fdbb_4989_a5ae_d9e1c1b76cd5_/


I am moving this BZ's status to VERIFIED.

Comment 24 errata-xmlrpc 2021-12-09 20:18:00 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat OpenStack Platform 16.1.7 (Train) bug fix and enhancement advisory), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:3762