Bug 1570615 – random scenario tempest tests fail due to Floating IP not reachable

Bugzilla will be upgraded to version 5.0. The upgrade date is tentatively scheduled for 2 December 2018, pending final testing and feedback.

Bug 1570615 - random scenario tempest tests fail due to Floating IP not reachable

Summary:	random scenario tempest tests fail due to Floating IP not reachable

Status:	CLOSED ERRATA

Aliases:	None

Product:	Red Hat OpenStack
Classification:	Red Hat
Component:	opendaylight (Show other bugs)
Sub Component:
Version:	13.0 (Queens)
Hardware:	Unspecified Unspecified

Priority	urgent Severity high
Target Milestone:	beta
Target Release:	13.0 (Queens)
Assigned To:	Aswin Suryanarayanan
QA Contact:	Waldemar Znoinski
Docs Contact:

URL:
Whiteboard:	odl_netvirt
Keywords:	Triaged

Depends On:
Blocks:
	Show dependency tree / graph

Reported:	2018-04-23 06:45 EDT by Waldemar Znoinski
Modified:	2018-10-18 03:18 EDT (History)
CC List:	8 users (show)

See Also:
Fixed In Version:	opendaylight-8.0.0-8.el7ost
Doc Type:	If docs needed, set a value
Doc Text:
Story Points:	---
Clone Of:
Environment:	N/A
Last Closed:	2018-06-27 09:52:04 EDT
Type:	Bug
Regression:	---
Mount Type:	---
Documentation:	---
CRM:
Verified Versions:
Category:	---
oVirt Team:	---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---

Flags:	asuryana: needinfo-

Attachments	(Terms of Use)
opendaylight_osp13_flapping_fip.html (3.28 MB, text/html) 2018-04-23 06:45 EDT, Waldemar Znoinski	no flags	Details
new random FIP issue (1.27 MB, text/html) 2018-05-09 07:58 EDT, Waldemar Znoinski	no flags	Details
Add an attachment (proposed patch, testcase, etc.)

External Trackers
Tracker	ID	Priority	Status	Summary	Last Updated
OpenDaylight gerrit	70375	None	None	None	2018-04-25 10:55 EDT
Red Hat Product Errata	RHEA-2018:2086	None	None	None	2018-06-27 09:54 EDT

Groups: None (edit)

Description Waldemar Znoinski 2018-04-23 06:45:35 EDT

Created attachment 1425641 [details]
opendaylight_osp13_flapping_fip.html

Description of problem:
Random scenario tempest tests fail due to 'connection to Floating IP timeout'.
errors:
- Connection to the 10.0.0.219 via SSH timed out (see 'test_snapshot_pattern' in 'opendaylight_osp13_flapping_fip.html' attachment)
- Timed out waiting for 10.0.0.215 to become reachable (see 'test_server_connectivity_stop_start' in 'opendaylight_osp13_flapping_fip.html' attachment)
- other relating to not being able to ssh connect to FIP (while VM already has received fixed IP)

Version-Release number of selected component (if applicable):
opendaylight-8.0.0-5
osp13, puddle 2018-04-19.2

How reproducible:
10%, can be reproduced only if multiple scenario tempest tests are run at the same time (even in serial, concurrenty=1, mode)

Steps to Reproduce:
1. deploy OSP with opendaylight
2. run tempest with --regex tempest.scenario.*
3.

Actual results:
random scenario tempest tests fail to connect to floating IP of VMs

Expected results:
connectivity to FIP of VMs work, tests to pass

Additional info:

Comment 1 Waldemar Znoinski 2018-04-23 06:47:06 EDT

this bug may be as a result of https://bugzilla.redhat.com/show_bug.cgi?id=1556686 but it hasn't been confirmed

Comment 2 Aswin Suryanarayanan 2018-04-23 08:12:31 EDT

This bug is expected to be fixed by [1]. Now running the CI with the patch to see if there is any improvements in the no of failures.

[1]https://code.engineering.redhat.com/gerrit/#/c/136293/

Comment 8 Aswin Suryanarayanan 2018-04-30 03:07:14 EDT

The Flapping FIP issue is not observed after merging [1]

[1]https://bugzilla.redhat.com/show_bug.cgi?id=1570615

Comment 16 Waldemar Znoinski 2018-05-09 07:58 EDT

Created attachment 1433766 [details]
new random FIP issue

Comment 17 Waldemar Znoinski 2018-05-09 07:59:53 EDT

it looked like the random FIP problems went away (didn't appear in last ~2 weeks), it happened last night (it may be same or a new FIP issue) - see the above attachment

Comment 20 errata-xmlrpc 2018-06-27 09:52:04 EDT

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2018:2086

Note You need to log in before you can comment on or make changes to this bug.