I am able to reproduce this on a mitaka-based RDO tripleo-quickstart env.

I think this error is a result of
a) not having configured a local tempest directory
b) not having run the config_tempest.py script prior to 'testr list-tests'

The pattern I have seen for using tempest with RDO/OSP on undercloud is:
su - stack
mkdir ~/tempest
cd ~/tempest
/usr/share/openstack-tempest-*/tools/configure-tempest-directory
<run tools/config_tempest.py appropriately>
testr list-tests

This approach creates/uses ~/tempest/etc/tempest.conf and works for me. I don't think the error you are hitting is a bug with the tempest package.

Rohit, Poornima,

Provide Clarification that with Steve's suggested approach it works or not ? 

Regards,
Suman

We are facing this issue in Packstack environment (In reply to Steve Linabery from comment #3)
> I am able to reproduce this on a mitaka-based RDO tripleo-quickstart env.
> 
> I think this error is a result of
> a) not having configured a local tempest directory
> b) not having run the config_tempest.py script prior to 'testr list-tests'
> 
> The pattern I have seen for using tempest with RDO/OSP on undercloud is:
> su - stack
> mkdir ~/tempest
> cd ~/tempest
> /usr/share/openstack-tempest-*/tools/configure-tempest-directory
> <run tools/config_tempest.py appropriately>
> testr list-tests
> 
> This approach creates/uses ~/tempest/etc/tempest.conf and works for me. I
> don't think the error you are hitting is a bug with the tempest package.

We are facing this issue in Packstack deployment, with earlier puddle[4th july] this used to work fine,but in this puddle we are facing issue while listing.

[root@dhcp207-39 tempest]# rpm -qa |grep -i tempest
python-tempest-lib-1.0.0-1.el7ost.noarch
openstack-tempest-10.0.0-2.b4a056dgit.el7ost.noarch

(In reply to Steve Linabery from comment #3)
> I am able to reproduce this on a mitaka-based RDO tripleo-quickstart env.
> 
> I think this error is a result of
> a) not having configured a local tempest directory
> b) not having run the config_tempest.py script prior to 'testr list-tests'
> 
> The pattern I have seen for using tempest with RDO/OSP on undercloud is:
> su - stack
> mkdir ~/tempest
> cd ~/tempest
> /usr/share/openstack-tempest-*/tools/configure-tempest-directory
> <run tools/config_tempest.py appropriately>
> testr list-tests
> 
> This approach creates/uses ~/tempest/etc/tempest.conf and works for me. I
> don't think the error you are hitting is a bug with the tempest package.

Hi Steve,

We have configured tempest.conf appropriately, as rohit mentioned this was working in previous puddle See below steps on the latest puddle OSP9 environment:

<snip>
#cd /usr/share/openstack-tempest-10.0.0/

[root@rhos9latest openstack-tempest-10.0.0]# pwd
/usr/share/openstack-tempest-10.0.0

[root@rhos9latest openstack-tempest-10.0.0]# ls
doc  HACKING.rst  openstack-common.conf  README.rst    REVIEWING.rst   run_tests.sh  setup.py   setup.pyo  tempest.egg-info  tox.ini
etc  LICENSE      README.rpm             releasenotes  run_tempest.sh  setup.cfg     setup.pyc  tempest    tools
[root@rhos9latest openstack-tempest-10.0.0]# ./run_tempest.sh -N -C /etc/redhat-certification-openstack/tempest.conf
/usr/lib/python2.7/site-packages/tempest_lib/__init__.py:28: DeprecationWarning: tempest-lib is deprecated for future bug-fixes and code changes in favor of tempest. Please change your imports from tempest_lib to tempest.lib
  DeprecationWarning)
Non-zero exit code (2) from test listing.
running=OS_STDOUT_CAPTURE=${OS_STDOUT_CAPTURE:-1} \
OS_STDERR_CAPTURE=${OS_STDERR_CAPTURE:-1} \
OS_TEST_TIMEOUT=${OS_TEST_TIMEOUT:-500} \
OS_TEST_LOCK_PATH=${OS_TEST_LOCK_PATH:-${TMPDIR:-'/tmp'}} \
${PYTHON:-python} -m subunit.run discover -t ${OS_TOP_LEVEL:-./} ${OS_TEST_PATH:-./tempest/test_discover} --list 
--- import errors ---
Failed to import test module: ironic_tempest_plugin.tests.api.admin.test_api_discovery
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/unittest2/loader.py", line 445, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib/python2.7/site-packages/unittest2/loader.py", line 384, in _get_module_from_name
    __import__(name)
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/tests/api/admin/test_api_discovery.py", line 15, in <module>
    from ironic_tempest_plugin.tests.api.admin import base
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/tests/api/admin/base.py", line 20, in <module>
    from ironic_tempest_plugin import clients
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/clients.py", line 25, in <module>
    ADMIN_CREDS = common_creds.get_configured_admin_credentials()
AttributeError: 'module' object has no attribute 'get_configured_admin_credentials'

Failed to import test module: ironic_tempest_plugin.tests.api.admin.test_chassis
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/unittest2/loader.py", line 445, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib/python2.7/site-packages/unittest2/loader.py", line 384, in _get_module_from_name
    __import__(name)
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/tests/api/admin/test_chassis.py", line 19, in <module>
    from ironic_tempest_plugin.tests.api.admin import base
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/tests/api/admin/base.py", line 20, in <module>
    from ironic_tempest_plugin import clients
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/clients.py", line 25, in <module>
    ADMIN_CREDS = common_creds.get_configured_admin_credentials()
AttributeError: 'module' object has no attribute 'get_configured_admin_credentials'

Failed to import test module: ironic_tempest_plugin.tests.api.admin.test_drivers
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/unittest2/loader.py", line 445, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib/python2.7/site-packages/unittest2/loader.py", line 384, in _get_module_from_name
    __import__(name)
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/tests/api/admin/test_drivers.py", line 18, in <module>
    from ironic_tempest_plugin.tests.api.admin import base
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/tests/api/admin/base.py", line 20, in <module>
    from ironic_tempest_plugin import clients
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/clients.py", line 25, in <module>
    ADMIN_CREDS = common_creds.get_configured_admin_credentials()
AttributeError: 'module' object has no attribute 'get_configured_admin_credentials'

Failed to import test module: ironic_tempest_plugin.tests.api.admin.test_nodes
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/unittest2/loader.py", line 445, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib/python2.7/site-packages/unittest2/loader.py", line 384, in _get_module_from_name
    __import__(name)
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/tests/api/admin/test_nodes.py", line 19, in <module>
    from ironic_tempest_plugin.tests.api.admin import base
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/tests/api/admin/base.py", line 20, in <module>
    from ironic_tempest_plugin import clients
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/clients.py", line 25, in <module>
    ADMIN_CREDS = common_creds.get_configured_admin_credentials()
AttributeError: 'module' object has no attribute 'get_configured_admin_credentials'

Failed to import test module: ironic_tempest_plugin.tests.api.admin.test_nodestates
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/unittest2/loader.py", line 445, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib/python2.7/site-packages/unittest2/loader.py", line 384, in _get_module_from_name
    __import__(name)
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/tests/api/admin/test_nodestates.py", line 19, in <module>
    from ironic_tempest_plugin.tests.api.admin import base
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/tests/api/admin/base.py", line 20, in <module>
    from ironic_tempest_plugin import clients
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/clients.py", line 25, in <module>
    ADMIN_CREDS = common_creds.get_configured_admin_credentials()
AttributeError: 'module' object has no attribute 'get_configured_admin_credentials'

Failed to import test module: ironic_tempest_plugin.tests.api.admin.test_ports
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/unittest2/loader.py", line 445, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib/python2.7/site-packages/unittest2/loader.py", line 384, in _get_module_from_name
    __import__(name)
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/tests/api/admin/test_ports.py", line 18, in <module>
    from ironic_tempest_plugin.tests.api.admin import base
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/tests/api/admin/base.py", line 20, in <module>
    from ironic_tempest_plugin import clients
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/clients.py", line 25, in <module>
    ADMIN_CREDS = common_creds.get_configured_admin_credentials()
AttributeError: 'module' object has no attribute 'get_configured_admin_credentials'

Failed to import test module: ironic_tempest_plugin.tests.api.admin.test_ports_negative
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/unittest2/loader.py", line 445, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib/python2.7/site-packages/unittest2/loader.py", line 384, in _get_module_from_name
    __import__(name)
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/tests/api/admin/test_ports_negative.py", line 17, in <module>
    from ironic_tempest_plugin.tests.api.admin import base
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/tests/api/admin/base.py", line 20, in <module>
    from ironic_tempest_plugin import clients
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/clients.py", line 25, in <module>
    ADMIN_CREDS = common_creds.get_configured_admin_credentials()
AttributeError: 'module' object has no attribute 'get_configured_admin_credentials'

Failed to import test module: ironic_tempest_plugin.tests.scenario.test_baremetal_basic_ops
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/unittest2/loader.py", line 445, in _find_test_path
    module = self._get_module_from_name(name)
  File "/usr/lib/python2.7/site-packages/unittest2/loader.py", line 384, in _get_module_from_name
    __import__(name)
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/tests/scenario/test_baremetal_basic_ops.py", line 21, in <module>
    from ironic_tempest_plugin.tests.scenario import baremetal_manager
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/tests/scenario/baremetal_manager.py", line 23, in <module>
    from ironic_tempest_plugin import clients
  File "/usr/lib/python2.7/site-packages/ironic_tempest_plugin/clients.py", line 25, in <module>
    ADMIN_CREDS = common_creds.get_configured_admin_credentials()
AttributeError: 'module' object has no attribute 'get_configured_admin_credentials'
The test run didn't actually run any tests

</snip>

we have been running tempest like this without any issues and it works appropriately .

Just to add : We have checked code there is no method 
"get_configured_admin_credentials" as the errors points this method is missing and which is there in upstream .

Ref of changes in upstream:-
https://github.com/openstack/tempest/commit/bc0a7a6d8022c7240f5f1f80c0c93b43e9037ad4

This needs to be fixed on priority.

Let me know if you need any further details. 

Thanks
Poornima

@Poornima,

Why is this a bug in Ironic?

It sounds to me that the tempest repository in OSP9 should be rebased to include https://review.openstack.org/#/c/321805 not the other way around.

Hi Lucas
As the bug is due to ironic auth client this component was changed as per https://bugzilla.redhat.com/show_bug.cgi?id=1356092#c4, 
I have raised needinfo on daniel so that he can answer queries with respect to tempest.

I've posted a patch to Ironic making the tempest call to get the admin credentials backward-compatible

Is this set of Requires insufficient?

[stack@undercloud ~]$ rpm -q --requires openstack-tempest | grep ironic
python-ironic-tests
python-ironicclient

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHEA-2016-1597.html