Bug 1980736 - Tests results showing as blocked in internal tooling due to the signature randomness in the Tempest suite
Summary: Tests results showing as blocked in internal tooling due to the signature ran...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: python-manila-tests-tempest
Version: 16.2 (Train)
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: z4
: 16.2 (Train on RHEL 8.4)
Assignee: lkuchlan
QA Contact: lkuchlan
URL:
Whiteboard:
Depends On:
Blocks: 2143578
TreeView+ depends on / blocked
 
Reported: 2021-07-09 12:09 UTC by Victoria Martinez de la Cruz
Modified: 2022-12-07 19:22 UTC (History)
5 users (show)

Fixed In Version: python-manila-tests-tempest-1.4.0-2.20220914204731.f083c71.el8ost
Doc Type: No Doc Update
Doc Text:
Clone Of:
: 2143578 (view as bug list)
Environment:
Last Closed: 2022-12-07 19:21:44 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
OpenStack gerrit 701108 0 None master: MERGED manila-tempest-plugin: Add uuid for tests (I262c7df709a8a7e9ed36591571069b9bcef0f51c) 2022-10-31 15:34:28 UTC
OpenStack gerrit 755859 0 None master: MERGED manila-tempest-plugin: Preserve the items order when calling ddt.data() (I9cbd26016238c25487ac8104c1188cd2cf4f467e) 2022-10-31 15:34:33 UTC
OpenStack gerrit 770954 0 None master: MERGED manila-tempest-plugin: Remove further randomness when calling ddt.data() (I15bfbf6e1ca604f2bf2fcf12dcd4e67bc728fe5e) 2022-10-31 15:34:39 UTC
OpenStack gerrit 840282 0 None master: MERGED manila-tempest-plugin: Remove unneeded randomness when calling ddt.data() (I8fce553d927da6d94471ecdf4040bbbb4377d9cf) 2022-10-31 15:34:44 UTC
OpenStack gerrit 855813 0 None MERGED Use ddt.named_data decorator to avoid random test names 2022-11-03 09:39:08 UTC
Red Hat Issue Tracker OSP-6085 0 None None None 2021-11-15 13:08:33 UTC
Red Hat Product Errata RHBA-2022:8794 0 None None None 2022-12-07 19:22:17 UTC

Comment 1 OSP Team 2022-08-08 10:38:15 UTC
According to our records, this should be resolved by python-manila-tests-tempest-1.4.0-2.20210629204822.f083c71.el8ost.  This build is available now.

Comment 2 lkuchlan 2022-08-18 08:00:08 UTC
Tested using:
python3-manila-tests-tempest-1.8.0-0.20220427151611.ee15891.el9ost.noarch

There are still 2 tests that generate random names.
There is already a patch that was merged upstream but need to be back-ported downstream:
https://review.opendev.org/c/openstack/manila-tempest-plugin/+/840282

Comment 3 Luigi Toscano 2022-08-25 08:15:15 UTC
(In reply to lkuchlan from comment #2)
> Tested using:
> python3-manila-tests-tempest-1.8.0-0.20220427151611.ee15891.el9ost.noarch
> 
> There are still 2 tests that generate random names.
> There is already a patch that was merged upstream but need to be back-ported
> downstream:
> https://review.opendev.org/c/openstack/manila-tempest-plugin/+/840282

Even using that patch, there are a few tests which inject a full random ssh key in the test signature whose signature will continue to change. No patch for that at this point, probably a discussion is needed to find out whether exposing that information in the test signature is relevant or not.

Comment 4 Goutham Pacha Ravi 2022-08-25 23:34:34 UTC
(In reply to Luigi Toscano from comment #3)
> (In reply to lkuchlan from comment #2)
> > Tested using:
> > python3-manila-tests-tempest-1.8.0-0.20220427151611.ee15891.el9ost.noarch
> > 
> > There are still 2 tests that generate random names.
> > There is already a patch that was merged upstream but need to be back-ported
> > downstream:
> > https://review.opendev.org/c/openstack/manila-tempest-plugin/+/840282
> 
> Even using that patch, there are a few tests which inject a full random ssh
> key in the test signature whose signature will continue to change. No patch
> for that at this point, probably a discussion is needed to find out whether
> exposing that information in the test signature is relevant or not.

Oh, i'm not aware of any test needing an SSH key as data. Do you mean this one? https://github.com/openstack/manila-tempest-plugin/blob/86f2432476ba9128bb2c26a78ae3b3f53327d4bd/manila_tempest_tests/tests/api/test_access_rules_metadata_negative.py#L71-L79

Comment 5 lkuchlan 2022-08-28 10:30:27 UTC
I found 2 tests that generate random names because one of the parameters generates a random value:
https://github.com/openstack/manila-tempest-plugin/blob/86f2432476ba9128bb2c26a78ae3b3f53327d4bd/manila_tempest_tests/tests/api/admin/test_share_types.py#L117
https://github.com/openstack/manila-tempest-plugin/blob/149acc51adf0c17b22fe690a2e9018596bcc5bbd/manila_tempest_tests/tests/api/test_share_types_negative.py#L91

In the new version(1.6.0) of ddt there is an option to define a name for the test without depending on the given values:
https://github.com/datadriventests/ddt/blob/2125da16830c69c87f237640e617729ffcbf235a/ddt.py#L416

This can be a solution for these cases.

Comment 10 lkuchlan 2022-11-03 09:39:09 UTC
Tested using:
python3-manila-tests-tempest-1.4.0-2.20210629204822.f083c71.el8ost.noarch

There is one more patch that didn't land downstream:
https://review.opendev.org/c/openstack/manila-tempest-plugin/+/855813

Comment 11 Luigi Toscano 2022-11-07 09:09:01 UTC
(In reply to lkuchlan from comment #10)
> Tested using:
> python3-manila-tests-tempest-1.4.0-2.20210629204822.f083c71.el8ost.noarch
> 
> There is one more patch that didn't land downstream:
> https://review.opendev.org/c/openstack/manila-tempest-plugin/+/855813

That patch can't land downstream because we use a different version of ddt. ddt 1.6.0 is only available upstream from stable/zed.

Comment 12 lkuchlan 2022-11-10 12:30:51 UTC
(In reply to Luigi Toscano from comment #11)
> (In reply to lkuchlan from comment #10)
> > Tested using:
> > python3-manila-tests-tempest-1.4.0-2.20210629204822.f083c71.el8ost.noarch
> > 
> > There is one more patch that didn't land downstream:
> > https://review.opendev.org/c/openstack/manila-tempest-plugin/+/855813
> 
> That patch can't land downstream because we use a different version of ddt.
> ddt 1.6.0 is only available upstream from stable/zed.

Is it make sense to close it and move it to VERIFIED even though the randomness isn't completely resolved ?
Because I don't see any other way to solve it.

Comment 13 Luigi Toscano 2022-11-10 12:56:27 UTC
(In reply to lkuchlan from comment #12)
> (In reply to Luigi Toscano from comment #11)
> > (In reply to lkuchlan from comment #10)
> > > Tested using:
> > > python3-manila-tests-tempest-1.4.0-2.20210629204822.f083c71.el8ost.noarch
> > > 
> > > There is one more patch that didn't land downstream:
> > > https://review.opendev.org/c/openstack/manila-tempest-plugin/+/855813
> > 
> > That patch can't land downstream because we use a different version of ddt.
> > ddt 1.6.0 is only available upstream from stable/zed.
> 
> Is it make sense to close it and move it to VERIFIED even though the
> randomness isn't completely resolved ?
> Because I don't see any other way to solve it.

That last patch can't work on 16.x (and maybe not even in 17.x), so
- either the bug stays on 16.2.4 but another solution is needed,
- or the scope of the bug, still on 16.2.4, is reduced,
- or the bug is retargeted to 18, or 17 if ddt can be bumped there - that upstream patch may be problematic for 17.x too.

Comment 18 lkuchlan 2022-11-17 09:39:57 UTC
There are still two test cases that generate random signatures.
Fixing them requires version 1.6.0 of ddt, however, in OSP 16.2 
the packaged version is 1.2.0.
Since it's an old version, we move this bz to VERIFIED and
clone it to OSP 18.

Comment 24 errata-xmlrpc 2022-12-07 19:21:44 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Release of components for Red Hat OpenStack Platform 16.2.4), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2022:8794


Note You need to log in before you can comment on or make changes to this bug.