From RHOS-12 onwards, all the OpenStack services are getting containerized. In order to move to containerized OpenStack distribution, we need to containerize OpenStack tempest also. Tempest is a set of integration tests to be run against a live OpenStack cluster. Tempest has batteries of tests for OpenStack API validation, Scenarios, and other specific tests useful in validating an OpenStack deployment. Tempest is an application which run from undercloud to validate overcloud cloud. Apart from OpenStack core services, other services are validated by using their respective tempest plugins. Expected Outcome: * Containerized tempest is available on Undercloud. * Enduser can run tempest from containerized against overcloud from undercloud in order to validate the overcloud. * Containerized tempest should expose the complete tempest cli on undercloud. Challenges: * How to containerize tempest plugins with respect to containerized Tempest?
Chandan, Are there any additional rpm deps for tempest when you move to a container?
Hello Wes, New dependency python-stestr will be included as a Requires for Tempest as a part of Queens Release. Here is the tracker bug: https://bugzilla.redhat.com/show_bug.cgi?id=1507001
We are keeping tempest container in tech preview as it is dependent on containerized undercloud which is coming in RHOS-14. Here is the doc instructions on how to use it: https://blogs.rdoproject.org/2018/05/consuming-kolla-tempest-container-image-for-running-tempest-tests/ And moving the bz to Modified
Expected Outcome: * Containerized tempest is available on Undercloud. It's not available on Undercloud, it's in tech preview, but it can be pulled, for example I was able to pull it from: registry.access.redhat.com/rhosp13-beta/openstack-tempest So we could consider this point as done. * Enduser can run tempest from containerized against overcloud from undercloud in order to validate the overcloud. * Containerized tempest should expose the complete tempest cli on undercloud. For the two expected outcomes above, there is no documentation for that for RHOS 13 [1], for example in comparison in RHOS12 [2]. How should a user know how to run it? How should a user know that the tempest cli is exposed completely? There is only a link to a blog [3], which explains that, but in my opinion it's not enough. [1] https://access.redhat.com/documentation/en-us/red_hat_openstack_platform/13/html-single/openstack_integration_test_suite_guide [2] https://access.redhat.com/documentation/en-us/red_hat_openstack_platform/12/html-single/openstack_integration_test_suite_guide/ [3] https://blogs.rdoproject.org/2018/05/consuming-kolla-tempest-container-image-for-running-tempest-tests/ Chandan, in our discussion on IRC, you said, there is a bug for the missing documentation, can you add the link for that here? I'm not sure if we can mark this as verified without having an official documentation.
Martin, There is a pending review for updated tempest doc [1]. Please assist in getting this through to merge. [1] https://review.openstack.org/#/c/565161/
The steps should not be specific to Tripleo-Quickstart at all. Steps should be outlined and documented for executing tempest manually which in fact is generated by TripleO-Quickstart but the tempest doc should not reference TripleO-Quickstart at all.
The proper documentation for containerized tempest is not correct in the review however the doc is avalable here [1] [1] http://logs.openstack.org/32/576632/2/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/d7345a3/logs/docs/build/tempest-setup.html Expecting to see updates to the review, to have QE confirm the steps and the documentation is of quality for tech preview.
(In reply to Chandan Kumar from comment #0) > Expected Outcome: > * Containerized tempest is available on Undercloud. As I mentioned before, the containerized tempest is not available on undercloud, but it can be pulled: $ docker pull registry.access.redhat.com/rhosp13-beta/openstack-tempest > * Enduser can run tempest from containerized against overcloud from > undercloud in order to validate the overcloud. This is verified, after the image is pulled a user can follow the documentation and run tempest from the container against overcloud or undercloud. I'm in touch with documentation team, so the documentation regarding to this will be available shortly after the release. > * Containerized tempest should expose the complete tempest cli on undercloud. This one is verified too. Tempest is installed inside the container, therefor a user can use all CLI arguments as if the tempest was not in a container. This was tested on a latest RHOS13 with core puddle = 2018-06-21.2. Just a note about challenges mentioned in the description: > * How to containerize tempest plugins with respect to containerized Tempest? The container available on registry.access.redhat.com/rhosp13-beta/openstack-tempest doesn't contain any Tempest plugins.
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHEA-2018:2085