Description of problem: In our last CI run TrunkTest.test_subport_connectivity test failed Response - Headers: {'status': '404', u'content-length': '111', 'content-location': 'http://10.0.0.108:8774/v2.1/servers/5eaa4480-3562-42a5-8019-ca4524bc04b0', u'x-compute-request-id': 'req-e97d14d7-0fb5-4d9c-8d86-dd8e0035384e', u'vary': 'OpenStack-API-Version,X-OpenStack-Nova-API-Version', u'server': 'Apache', u'openstack-api-version': 'compute 2.1', u'connection': 'close', u'x-openstack-nova-api-version': '2.1', u'date': 'Tue, 01 May 2018 09:54:24 GMT', u'content-type': 'application/json; charset=UTF-8', u'x-openstack-request-id': 'req-e97d14d7-0fb5-4d9c-8d86-dd8e0035384e'} Body: {"itemNotFound": {"message": "Instance 5eaa4480-3562-42a5-8019-ca4524bc04b0 could not be found.", "code": 404}} }}} Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/neutron_tempest_plugin/scenario/test_trunk.py", line 241, in test_subport_connectivity server['ssh_client'].exec_command(command) File "/usr/lib/python2.7/site-packages/tempest/lib/common/ssh.py", line 173, in exec_command cmd, self.host)) tempest.lib.exceptions.TimeoutException: Request timed out Details: Command: 'IFACE=$(PATH=$PATH:/usr/sbin ip l | grep "^[0-9]*: e" |cut -d \: -f 2) && sudo su -c "ip l a link $IFACE name $IFACE.10 type vlan id 10 &&ip l s up dev $IFACE.10 && dhclient $IFACE.10"' executed on host '10.0.0.223'. Version-Release number of selected component (if applicable): 13 -p 2018-04-26.3 How reproducible: 100% Steps to Reproduce: 1. run ci job: DFG-network-networking-ovn-13_director-rhel-virthost-3cont_2comp-ipv4-geneve-tempest-custom-image 2. 3. Actual results: Expected results: Additional info:
I've ran the test 30 times with no failures at all but it's failing consistently in the gate. My setup is OSP13 with 2018-05-02.5 puddle, 3 controllers 2 computes. The image I have used for tempest is rhel-guest-image-7.4-191.x86_64.qcow2 (same as the one using in our CI). Average time for this test is 190 seconds. After looking into the logs on CI it looks like the subport can't fetch IP address through DHCP. Some time back this test used to fail because the network where the subport is doesn't have a gateway and we needed that for the port to be able to fetch DHCP. However, we fixed it by using metadata port for this purpose. I checked and metadata is enabled in controllers so need further investigation.
In ovn-controller logs i can see that the DHCP offer occurs: 156 2018-05-04T00:36:48.858Z|00156|binding|INFO|Claiming lport 88df9449-214e-4230-afb1-d51518097994 for this chassis. 157 2018-05-04T00:36:48.858Z|00157|binding|INFO|88df9449-214e-4230-afb1-d51518097994: Claiming fa:16:3e:3f:2d:c9 10.100.0.6 158 2018-05-04T00:37:12.994Z|00158|pinctrl|INFO|DHCPOFFER fa:16:3e:3f:2d:c9 10.100.0.6 159 2018-05-04T00:37:13.027Z|00159|pinctrl|INFO|DHCPACK fa:16:3e:3f:2d:c9 10.100.0.6 160 2018-05-04T00:38:02.829Z|00160|pinctrl|INFO|DHCPOFFER fa:16:3e:33:6d:f1 10.100.0.27 161 2018-05-04T00:38:02.862Z|00161|pinctrl|INFO|DHCPACK fa:16:3e:33:6d:f1 10.100.0.27 162 2018-05-04T00:38:05.349Z|00162|pinctrl|INFO|DHCPOFFER fa:16:3e:33:6d:f1 10.100.0.27 163 2018-05-04T00:38:05.383Z|00163|pinctrl|INFO|DHCPACK fa:16:3e:33:6d:f1 10.100.0.27 164 2018-05-04T00:38:29.915Z|00164|binding|INFO|Releasing lport 88df9449-214e-4230-afb1-d51518097994 from this chassis.
I did further research and found out the problem. I reported it upstream [0] and proposed a revert for the commit causing the regression [1]. After setting a breakpoint on the test, I could log into the guest VM through virsh and checked that the default route is overriden and the connectivity to the FIP is broken: [root@tempest-server-test-378882328 ~]# ip r default via 10.100.0.17 dev eth0.10 default via 10.100.0.1 dev eth0 proto static metric 100 default via 10.100.0.17 dev eth0.10 proto static metric 400 10.100.0.0/28 dev eth0 proto kernel scope link src 10.100.0.5 metric 100 10.100.0.16/28 dev eth0.10 proto kernel scope link src 10.100.0.25 169.254.169.254 via 10.100.0.18 dev eth0.10 proto dhcp 169.254.169.254 via 10.100.0.2 dev eth0 proto dhcp metric 100 [0] https://bugs.launchpad.net/neutron/+bug/1769609 [1] https://review.openstack.org/#/c/566539/
BTW, in my previous comment C2 I said that it was same puddle while it is not, which explains the different behavior: Working setup: ============== (overcloud) [stack@undercloud-0 ~]$ cat core_puddle_version 2018-04-19.2 [root@compute-0 ~]# sudo rpm -qa |grep openvswitch openvswitch-2.9.0-15.el7fdp.x86_64 python-openvswitch-2.9.0-15.el7fdp.noarch openvswitch-ovn-central-2.9.0-15.el7fdp.x86_64 openstack-neutron-openvswitch-12.0.2-0.20180413152754.7a67987.el7ost.noarch openvswitch-ovn-host-2.9.0-15.el7fdp.x86_64 openvswitch-ovn-common-2.9.0-15.el7fdp.x86_64 [root@tempest-server-test-1136331080 ~]# ip r default via 10.100.0.1 dev eth0 proto static metric 100 default via 10.100.0.17 dev eth0.10 proto static metric 400 10.100.0.0/28 dev eth0 proto kernel scope link src 10.100.0.3 metric 100 10.100.0.16/28 dev eth0.10 proto kernel scope link src 10.100.0.25 169.254.169.254 via 10.100.0.18 dev eth0.10 proto static 169.254.169.254 via 10.100.0.2 dev eth0 proto dhcp metric 100 Non working setup: ================== (overcloud) [stack@undercloud-0 ~]$ cat core_puddle_version 2018-05-03.2 [root@compute-1 ~]# rpm -qa | grep openvswitch openvswitch-ovn-central-2.9.0-20.el7fdp.x86_64 openvswitch-2.9.0-20.el7fdp.x86_64 openvswitch-ovn-common-2.9.0-20.el7fdp.x86_64 python-openvswitch-2.9.0-20.el7fdp.noarch openvswitch-ovn-host-2.9.0-20.el7fdp.x86_64 openstack-neutron-openvswitch-12.0.2-0.20180421011358.0ec54fd.el7ost.noarch [root@tempest-server-test-378882328 ~]# ip r default via 10.100.0.17 dev eth0.10 default via 10.100.0.1 dev eth0 proto static metric 100 default via 10.100.0.17 dev eth0.10 proto static metric 400 10.100.0.0/28 dev eth0 proto kernel scope link src 10.100.0.5 metric 100 10.100.0.16/28 dev eth0.10 proto kernel scope link src 10.100.0.25 169.254.169.254 via 10.100.0.18 dev eth0.10 proto dhcp 169.254.169.254 via 10.100.0.2 dev eth0 proto dhcp metric 100 So, even though there're differences as why the default route (without a metric) is installed in the non-working case, we should avoid setting a gateway on a subnet which doesn't really have it.
Patches not merged yet upstream, moving from POST back to ON_DEV.
Failed QA: 13.0-RHEL-7/2018-08-07.5 python2-neutron-tests-tempest-0.0.1-0.20180425142843.02a5e2b.el7ost.noarch u'x-openstack-nova-api-version': '2.1', u'date': 'Thu, 09 Aug 2018 06:41:52 GMT', u'content-type': 'application/json; charset=UTF-8', u'x-openstack-request-id': 'req-0c19f425-e68d-473c-a809-bed05257e033'} Body: {"itemNotFound": {"message": "Instance 87c0e19c-f627-4a86-8ee3-7f8a7acbf548 could not be found.", "code": 404}} }}} Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/neutron_tempest_plugin/scenario/test_trunk.py", line 243, in test_subport_connectivity server['ssh_client'].exec_command(command) File "/usr/lib/python2.7/site-packages/tempest/lib/common/ssh.py", line 173, in exec_command cmd, self.host)) tempest.lib.exceptions.TimeoutException: Request timed out Details: Command: 'IFACE=$(PATH=$PATH:/usr/sbin ip l | grep "^[0-9]*: e" |cut -d \: -f 2) && sudo su -c "ip l a link $IFACE name $IFACE.10 type vlan id 10 &&ip l s up dev $IFACE.10 && dhclient $IFACE.10"' executed on host '10.0.0.210'. Ran 1 test in 481.960s FAILED (failures=1)
Problem is that the package in the 'fixed in version' field is wrong as it doesn't include the fix. The package that contains the fix is newer than that but it's not in OSP13 (see C7). I have sent this patch to get the fix in RDO Queens: https://review.rdoproject.org/r/15330 Not sure if we can speed it up in OSP or we need to wait for the next RDO Queens promotion and then wait for the automatic import to happen.
1. By default, the test is skipping because of @utils.unstable_test('bug 1766701'). To run the test I removed the decorator. 2. After removing the decorator the test failed: eq-e4ac616a-8df5-428b-b8c4-2e211cb463b7', u'vary': 'OpenStack-API-Version,X-OpenStack-Nova-API-Version', u'server': 'Apache', u'openstack-api-version': 'compute 2.1', u'connection': 'close', u'x-openstack-nova-api-version': '2.1', u'date': 'Wed, 31 Oct 2018 10:44:03 GMT', u'content-type': 'application/json; charset=UTF-8', u'x-openstack-request-id': 'req-e4ac616a-8df5-428b-b8c4-2e211cb463b7'} Body: {"itemNotFound": {"message": "Instance e989ef1e-08e5-4736-8d01-6a3bc46b3ffd could not be found.", "code": 404}} }}} Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/neutron_tempest_plugin/scenario/test_trunk.py", line 237, in test_subport_connectivity for i in range(2)] File "/usr/lib/python2.7/site-packages/tempest/lib/common/ssh.py", line 173, in exec_command cmd, self.host)) tempest.lib.exceptions.TimeoutException: Request timed out Details: Command: 'IFACE=$(PATH=$PATH:/usr/sbin ip l | grep "^[0-9]*: e" |cut -d \: -f 2) && sudo su -c "ip l a link $IFACE name $IFACE.10 type vlan id 10 &&ip l s up dev $IFACE.10 && dhclient $IFACE.10"' executed on host '10.0.0.210'. failed on : python2-neutron-tests-tempest-0.0.1-0.20180425142845.02a5e2b.el7ost.noarch osp13z3 2018-10-24.1
I have ran this test and connected to the VMs using virsh. Problem again is that the subnet of the subport gets a gateway so dhclient overwrites the default route: [root@tempest-server-test-152098106 ~]# IFACE=$(PATH=$PATH:/usr/sbin ip l | grep "^[0-9]*: e"|cut -d \: -f 2) [root@tempest-server-test-152098106 ~]# echo $IFACE eth0 [root@tempest-server-test-152098106 ~]# sudo ip l a link $IFACE name $IFACE.10 type vlan id 10 [root@tempest-server-test-152098106 ~]# sudo ip l s up dev $IFACE.10 [root@tempest-server-test-152098106 ~]# ps -ef | grep -q "[d]hclient .*$IFACE.10" [root@tempest-server-test-152098106 ~]# ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN qlen 1 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1442 qdisc pfifo_fast state UP qlen 1000 link/ether fa:16:3e:24:fd:a0 brd ff:ff:ff:ff:ff:ff inet 10.100.0.6/28 brd 10.100.0.15 scope global dynamic eth0 valid_lft 43066sec preferred_lft 43066sec inet6 fe80::f816:3eff:fe24:fda0/64 scope link valid_lft forever preferred_lft forever 3: eth0.10@eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1442 qdisc noqueue state UP qlen 1000 link/ether fa:16:3e:24:fd:a0 brd ff:ff:ff:ff:ff:ff inet6 fe80::f816:3eff:fe24:fda0/64 scope link valid_lft forever preferred_lft forever [root@tempest-server-test-152098106 ~]# dhclient eth0.10 packet_write_wait: Connection to 10.0.0.241 port 22: Broken pipe (overcloud) [stack@undercloud-0 ~]$ [root@tempest-server-test-152098106 ~]# ip r default via 10.100.0.17 dev eth0.10 default via 10.100.0.1 dev eth0 proto static metric 100 default via 10.100.0.17 dev eth0.10 proto static metric 400 10.100.0.0/28 dev eth0 proto kernel scope link src 10.100.0.6 metric 100 10.100.0.16/28 dev eth0.10 proto kernel scope link src 10.100.0.19 169.254.169.254 via 10.100.0.18 dev eth0.10 proto dhcp 169.254.169.254 via 10.100.0.2 dev eth0 proto dhcp metric 100 [root@tempest-server-test-152098106 ~]# ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN qlen 1 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1442 qdisc pfifo_fast state UP qlen 1000 link/ether fa:16:3e:24:fd:a0 brd ff:ff:ff:ff:ff:ff inet 10.100.0.6/28 brd 10.100.0.15 scope global dynamic eth0 valid_lft 43008sec preferred_lft 43008sec inet6 fe80::f816:3eff:fe24:fda0/64 scope link valid_lft forever preferred_lft forever 3: eth0.10@eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1442 qdisc noqueue state UP qlen 1000 link/ether fa:16:3e:24:fd:a0 brd ff:ff:ff:ff:ff:ff inet 10.100.0.19/28 brd 10.100.0.31 scope global dynamic eth0.10 valid_lft 43153sec preferred_lft 43153sec inet6 fe80::f816:3eff:fe24:fda0/64 scope link valid_lft forever preferred_lft forever | b36ddca6-6ff7-4fe7-a279-51774432a31c | | fa:16:3e:24:fd:a0 | ip_address='10.100.0.19', subnet_id='0bfd0020-6c30-4045-b999-157893dd8d0d' | ACTIVE | (overcloud) [stack@undercloud-0 ~]$ openstack subnet show 0bfd0020-6c30-4045-b999-157893dd8d0d +-------------------+--------------------------------------+ | Field | Value | +-------------------+--------------------------------------+ | allocation_pools | 10.100.0.18-10.100.0.30 | | cidr | 10.100.0.16/28 | | created_at | 2018-11-02T13:57:44Z | | description | | | dns_nameservers | | | enable_dhcp | True | | gateway_ip | 10.100.0.17 | | host_routes | | | id | 0bfd0020-6c30-4045-b999-157893dd8d0d | | ip_version | 4 | | ipv6_address_mode | None | | ipv6_ra_mode | None | | name | | | network_id | 0265e5fd-db6b-416b-b114-f55b73a65fc1 | | project_id | be508518e91b47b399201d022ac6d53b | | revision_number | 0 | | segment_id | None | | service_types | | | subnetpool_id | None | | tags | | | updated_at | 2018-11-02T13:57:44Z | +-------------------+--------------------------------------+
Sorry, this was the correct subnet with gw 10.100.0.17: 2018-11-02 09:57:47.018 985956 INFO tempest.lib.common.rest_client [req-9ce05fd3-bfad-4517-a361-a40749a7ff0a ] Request (TrunkTest:test_subport_connectivity): 201 POST http://10.0.0.116:9696/v2.0/subnets 2.698s 2018-11-02 09:57:47.019 985956 DEBUG tempest.lib.common.rest_client [req-9ce05fd3-bfad-4517-a361-a40749a7ff0a ] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'} Body: {"subnet": {"ip_version": 4, "network_id": "0265e5fd-db6b-416b-b114-f55b73a65fc1", "cidr": "10.100.0.16/28"}} Response - Headers: {'status': '201', u'content-length': '605', 'content-location': 'http://10.0.0.116:9696/v2.0/subnets', u'date': 'Fri, 02 Nov 2018 13:57:47 GMT', u'content-type': 'application/json', u'connection': 'close', u'x-openstack-request-id': 'req-9ce05fd3-bfad-4517-a361-a40749a7ff0a'} Body: {"subnet":{"service_types":[],"description":"","enable_dhcp":true,"tags":[],"network_id":"0265e5fd-db6b-416b-b114-f55b73a65fc1","tenant_id":"be508518e91b47b399201d022ac6d53b","created_at":"2018-11-02T13:57:44Z","dns_nameservers":[],"updated_at":"2018-11-02T13:57:44Z","gateway_ip":"10.100.0.17","ipv6_ra_mode":null,"allocation_pools":[{"start":"10.100.0.18","end":"10.100.0.30"}],"host_routes":[],"revision_number":0,"ip_version":4,"ipv6_address_mode":null,"cidr":"10.100.0.16/28","project_id":"be508518e91b47b399201d022ac6d53b","id":"0bfd0020-6c30-4045-b999-157893dd8d0d","subnetpool_id":null,"name":""}} _log_request_full /usr/lib/python2.7/site-packages/tempest/lib/common/rest_client.py:436 2018-11-02 09:57:48.907 985956 INFO tempest.lib.common.rest_client [req-b1147595-0b0b-48ff-a8d4-5b92dc336f05 ] Request (TrunkTest:test_subport_connectivity): 201 POST http://10.0.0.116:9696/v2.0/ports 1.887s 2018-11-02 09:57:48.908 985956 DEBUG tempest.lib.common.rest_client [req-b1147595-0b0b-48ff-a8d4-5b92dc336f05 ] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'} Body: {"port": {"network_id": "dbcd519b-ea2a-40b9-ae3a-ba15f7eb1087", "security_groups": ["cda28eab-6935-4866-9721-6cc42fec3bbf"]}} Response - Headers: {'status': '201', u'content-length': '839', 'content-location': 'http://10.0.0.116:9696/v2.0/ports', u'date': 'Fri, 02 Nov 2018 13:57:48 GMT', u'content-type': 'application/json', u'connection': 'close', u'x-openstack-request-id': 'req-b1147595-0b0b-48ff-a8d4-5b92dc336f05'} Body: {"port":{"allowed_address_pairs":[],"extra_dhcp_opts":[],"updated_at":"2018-11-02T13:57:47Z","device_owner":"","revision_number":2,"port_security_enabled":true,"fixed_ips":[{"subnet_id":"5bde8f60-238b-421f-9640-5a6f357a7a4b","ip_address":"10.100.0.4"}],"id":"f2a0612a-55e0-4a33-b6ec-43a90f533196","security_groups":["cda28eab-6935-4866-9721-6cc42fec3bbf"],"mac_address":"fa:16:3e:e4:22:2c","device_id":"","status":"DOWN","description":"","tags":[],"dns_assignment":[{"hostname":"host-10-100-0-4","ip_address":"10.100.0.4","fqdn":"host-10-100-0-4.ovn.test."}],"name":"","project_id":"be508518e91b47b399201d022ac6d53b","qos_policy_id":null,"admin_state_up":true,"network_id":"dbcd519b-ea2a-40b9-ae3a-ba15f7eb1087","dns_name":"","created_at":"2018-11-02T13:57:47Z","binding:vnic_type":"normal","tenant_id":"be508518e91b47b399201d022ac6d53b"}} _log_request_full /usr/lib/python2.7/site-packages/tempest/lib/common/rest_client.py:436
When gateway was not specified, neutron will allocate an IP address for it [0]. Worked with Slaweq on this one who posted a patch [1]. I tried out the patch and the test passes successfully now: {0} neutron_tempest_plugin.scenario.test_trunk.TrunkTest.test_subport_connectivity [167.990876s] ... ok [0] https://github.com/openstack/neutron/blob/55be92e253a33c9a51ac9db3e444942920372904/neutron/db/ipam_backend_mixin.py#L58 [1] https://review.openstack.org/#/c/615206/
*** Bug 1646279 has been marked as a duplicate of this bug. ***
Backport to OSP-13 branch: https://code.engineering.redhat.com/gerrit/#/c/154943/
failed QA Body: {"server": {"OS-EXT-STS:task_state": "deleting", "addresses": {}, "links": [{"href": "http://10.0.0.128:8774/v2.1/servers/f9c85e02-9251-401b-a343-21f3bad92487", "rel": "self"}, {"href": "http://10.0.0.128:8774/servers/f9c85e02-9251-401b-a343-21f3bad92487", "rel": "bookmark"}], "image": {"id": "4a619528-e823-4841-93e9-bab57f3acafb", "links": [{"href": "http://10.0.0.128:8774/images/4a619528-e823-4841-93e9-bab57f3acafb", "rel": "bookmark"}]}, "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2018-11-11T11:32:46.000000", "flavor": {"id": "200", "links": [{"href": "http://10.0.0.128:8774/flavors/200", "rel": "bookmark"}]}, "id": "f9c85e02-9251-401b-a343-21f3bad92487", "user_id": "1edba393882747f68470e243dbe7b102", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "OS-EXT-AZ:availability_zone": "nova", "config_drive": "", "status": "ACTIVE", "updated": "2018-11-11T11:39:04Z", "hostId": "739be4f05ac342b94fc1b9a97d525e8a6af5541fabf781104e4a668a", "OS-SRV-USG:terminated_at": null, "key_name": "tempest-keypair-test-1392541511", "name": "tempest-server-test-1838204055", "created": "2018-11-11T11:32:20Z", "tenant_id": "1362456a75d74a1e88886bb2f8d28fd4", "os-extended-volumes:volumes_attached": [], "metadata": {}}} 2018-11-11 06:39:05,978 1117 INFO [tempest.lib.common.rest_client] Request (TrunkTest:_run_cleanups): 404 GET http://10.0.0.128:8774/v2.1/servers/f9c85e02-9251-401b-a343-21f3bad92487 0.072s 2018-11-11 06:39:05,978 1117 DEBUG [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'} Body: None Response - Headers: {'status': '404', u'content-length': '111', 'content-location': 'http://10.0.0.128:8774/v2.1/servers/f9c85e02-9251-401b-a343-21f3bad92487', u'x-compute-request-id': 'req-19fd08ca-077e-43d5-a386-d3e04b22ed39', u'vary': 'OpenStack-API-Version,X-OpenStack-Nova-API-Version', u'server': 'Apache', u'openstack-api-version': 'compute 2.1', u'connection': 'close', u'x-openstack-nova-api-version': '2.1', u'date': 'Sun, 11 Nov 2018 11:39:05 GMT', u'content-type': 'application/json; charset=UTF-8', u'x-openstack-request-id': 'req-19fd08ca-077e-43d5-a386-d3e04b22ed39'} Body: {"itemNotFound": {"message": "Instance f9c85e02-9251-401b-a343-21f3bad92487 could not be found.", "code": 404}} }}} Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/neutron_tempest_plugin/scenario/test_trunk.py", line 233, in test_subport_connectivity vlan_network = self.create_network() File "/usr/lib/python2.7/site-packages/tempest/lib/common/ssh.py", line 173, in exec_command cmd, self.host)) tempest.lib.exceptions.TimeoutException: Request timed out Details: Command: 'IFACE=$(PATH=$PATH:/usr/sbin ip l | grep "^[0-9]*: e" |cut -d \: -f 2) && sudo su -c "ip l a link $IFACE name $IFACE.10 type vlan id 10 &&ip l s up dev $IFACE.10 && dhclient $IFACE.10"' executed on host '10.0.0.223'. Ran 1 test in 477.661s FAILED (failures=1) (undercloud) [stack@undercloud-0 tempest-dir]$ cat /home/stack/co container_images.yaml core_puddle_version (undercloud) [stack@undercloud-0 tempest-dir]$ cat /home/stack/core_puddle_version 2018-11-07.3(undercloud) [stack@undercloud-0 tempest-dir]$ rpm -qa | grep neutron-tests-tempest python2-neutron-tests-tempest-0.0.1-0.20180425142845.02a5e2b.el7ost.noarch OpenStack/13.0-RHEL-7/2018-11-07.3/ it looks like the code in not inside the RPM
fix verified OpenStack/13.0-RHEL-7/2019-02-15.1/ python2-neutron-tests-tempest-0.0.1-0.20180425142846.02a5e2b.el7ost.noarch https://rhos-qe-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/DFG/view/network/view/networking-ovn/job/DFG-network-networking-ovn-13_director-rhel-virthost-3cont_2comp-ipv4-geneve-tempest-custom-image/82/testReport/neutron_tempest_plugin.scenario.test_trunk/TrunkTest/test_subport_connectivity_id_a8a02c9b_b453_49b5_89a2_cce7da66aafb_/
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2019:0555