Bug 2058722

Description of problem: Several Tempest test case failures: Failed to establish authenticated ssh connection to
heat-admin ([Errno -2] Name or service not known)


Version-Release number of selected component (if applicable):
16.1 and 16.2

How reproducible:
Everytime starting at least 6 builds ago

Steps to Reproduce:
1. Run relevant FFU job or specific tempest test (for example [1])
2.
3.

Actual results:
Test cases fail with "Failed to establish authenticated ssh connection to
heat-admin"

Expected results:
Test cases pass

Additional info:
Unsure if this is a product or test issue

[1] neutron_plugin.tests.scenario.test_neutron_availability_zones_ml2ovs.NeutronAvaliabilityzonesTest.test_router_created_in_default_azs


stack trace:

([Errno -2] Name or service not known). Number attempts: 23. Retry after 24 seconds.
2022-02-22 13:05:35,735 12260 ERROR    [tempest.lib.common.ssh] Failed to establish authenticated ssh connection to heat-admin after 23 attempts
2022-02-22 13:05:35.735 12260 ERROR tempest.lib.common.ssh Traceback (most recent call last):
2022-02-22 13:05:35.735 12260 ERROR tempest.lib.common.ssh   File "/usr/lib/python2.7/site-packages/tempest/lib/common/ssh.py", line 107, in _get_ssh_connection
2022-02-22 13:05:35.735 12260 ERROR tempest.lib.common.ssh     sock=proxy_chan)
2022-02-22 13:05:35.735 12260 ERROR tempest.lib.common.ssh   File "/home/stack/.local/lib/python2.7/site-packages/paramiko/client.py", line 340, in connect
2022-02-22 13:05:35.735 12260 ERROR tempest.lib.common.ssh     to_try = list(self._families_and_addresses(hostname, port))
2022-02-22 13:05:35.735 12260 ERROR tempest.lib.common.ssh   File "/home/stack/.local/lib/python2.7/site-packages/paramiko/client.py", line 204, in _families_and_addresses
2022-02-22 13:05:35.735 12260 ERROR tempest.lib.common.ssh     hostname, port, socket.AF_UNSPEC, socket.SOCK_STREAM
2022-02-22 13:05:35.735 12260 ERROR tempest.lib.common.ssh gaierror: [Errno -2] Name or service not known
2022-02-22 13:05:35.735 12260 ERROR tempest.lib.common.ssh
}}}


Traceback (most recent call last):
  File "/home/stack/plugins/tempest_neutron_plugin/neutron_plugin/tests/scenario/test_neutron_availability_zones_ml2ovs.py", line 408, in test_router_created_in_default_azs
    self._check_az_router(azs, router)
  File "/home/stack/plugins/tempest_neutron_plugin/neutron_plugin/tests/scenario/test_neutron_availability_zones_ml2ovs.py", line 102, in _check_az_router
    self._check_az_resource(az, router=router)
  File "/home/stack/plugins/tempest_neutron_plugin/neutron_plugin/tests/scenario/test_neutron_availability_zones_ml2ovs.py", line 188, in _check_az_resource
    utils.wait_until_true(test_resource_namespace)
  File "/usr/lib/python2.7/site-packages/neutron_tempest_plugin/common/utils.py", line 77, in wait_until_true
    while not predicate():
  File "/home/stack/plugins/tempest_neutron_plugin/neutron_plugin/tests/scenario/test_neutron_availability_zones_ml2ovs.py", line 159, in test_resource_namespace
    netns = self.get_node_client(node_name).exec_command('ip netns')
  File "/usr/lib/python2.7/site-packages/neutron_tempest_plugin/common/ssh.py", line 160, in exec_command
    return super(Client, self).exec_command(cmd=cmd, encoding=encoding)
  File "/usr/lib/python2.7/site-packages/tempest/lib/common/ssh.py", line 151, in exec_command
    ssh = self._get_ssh_connection()
  File "/usr/lib/python2.7/site-packages/tempest/lib/common/ssh.py", line 121, in _get_ssh_connection
    password=self.password)
tempest.lib.exceptions.SSHTimeout: Connection to the controller-0.ctlplane via SSH timed out.
User: heat-admin, Password: None