Bug 2223916

Summary: Tests related to port forwarding failing
Product: Red Hat OpenStack Reporter: Slawek Kaplonski <skaplons>
Component: python-networking-ovnAssignee: Slawek Kaplonski <skaplons>
Status: ON_DEV --- QA Contact: Maor <mblue>
Severity: high Docs Contact:
Priority: high    
Version: 17.1 (Wallaby)CC: apevec, ekuris, gregraka, lhh, majopela, mblue, pgrist, rsafrono, scohen
Target Milestone: z1Keywords: Triaged
Target Release: 17.1   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Known Issue
Doc Text:
In RHOSP 17.1 GA environments that use the ML2/OVN mechanism driver, there is a known issue with floating IP port forwarding not working correctly. This problem is caused because VLAN and flat networks distribute north-south network traffic when FIPs are used, and, instead, FIP port forwarding should be centralized on the Controller or the Networker nodes. + Workaround: To resolve this problem and force FIP port forwarding through the centralized gateway node, either set the RHOSP Orchestration service (heat) parameter `NeutronEnableDVR` to `false`, or use Geneve instead of VLAN or flat project networks.
Story Points: ---
Clone Of: Environment:
Last Closed: Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Slawek Kaplonski 2023-07-19 09:22:44 UTC
I found it failing in job DFG-network-neutron-17.1_director-rhel-virthost-3cont_2comp_1ipa-ipv4-vlan-tls-dvr-ovn

Link to error: https://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/job/DFG-network-neutron-17.1_director-rhel-virthost-3cont_2comp_1ipa-ipv4-vlan-tls-dvr-ovn/63//artifact/tempest-results/tempest-results-neutron.1.html

Traceback (most recent call last):
  File "/usr/lib/python3.9/site-packages/tempest/lib/common/ssh.py", line 136, in _get_ssh_connection
    ssh.connect(self.host, port=self.port, username=self.username,
  File "/usr/lib/python3.9/site-packages/paramiko/client.py", line 412, in connect
    server_key = t.get_remote_server_key()
  File "/usr/lib/python3.9/site-packages/paramiko/transport.py", line 879, in get_remote_server_key
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.9/site-packages/neutron_tempest_plugin/scenario/test_port_forwardings.py", line 129, in test_port_forwarding_to_2_servers
    self.check_servers_hostnames(servers)
  File "/usr/lib/python3.9/site-packages/neutron_tempest_plugin/scenario/base.py", line 592, in check_servers_hostnames
    ssh_client.get_hostname())
  File "/usr/lib/python3.9/site-packages/neutron_tempest_plugin/common/ssh.py", line 293, in get_hostname
    return self.exec_command('hostname')
  File "/usr/lib/python3.9/site-packages/tenacity/__init__.py", line 333, in wrapped_f
    return self(f, *args, **kw)
  File "/usr/lib/python3.9/site-packages/tenacity/__init__.py", line 423, in __call__
    do = self.iter(retry_state=retry_state)
  File "/usr/lib/python3.9/site-packages/tenacity/__init__.py", line 360, in iter
    return fut.result()
  File "/usr/lib64/python3.9/concurrent/futures/_base.py", line 439, in result
    return self.__get_result()
  File "/usr/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result
    raise self._exception
  File "/usr/lib/python3.9/site-packages/tenacity/__init__.py", line 426, in __call__
    result = fn(*args, **kwargs)
  File "/usr/lib/python3.9/site-packages/neutron_tempest_plugin/common/ssh.py", line 172, in exec_command
    return super(Client, self).exec_command(cmd=cmd, encoding=encoding)
  File "/usr/lib/python3.9/site-packages/tempest/lib/common/ssh.py", line 187, in exec_command
    ssh = self._get_ssh_connection()
  File "/usr/lib/python3.9/site-packages/tempest/lib/common/ssh.py", line 155, in _get_ssh_connection
    raise exceptions.SSHTimeout(host=self.host,
tempest.lib.exceptions.SSHTimeout: Connection to the 10.0.0.230 via SSH timed out.
User: cirros, Password: None