Bug 1401471 – PING test validation scripts fail during deployment, when DPDK nic is used for tenant network

Bugzilla will be upgraded to version 5.0. The upgrade date is tentatively scheduled for 2 December 2018, pending final testing and feedback.

Bug 1401471 - PING test validation scripts fail during deployment, when DPDK nic is used for tenant network

Summary:	PING test validation scripts fail during deployment, when DPDK nic is used fo...

Status:	CLOSED ERRATA

Aliases:	None

Product:	Red Hat OpenStack
Classification:	Red Hat
Component:	openstack-tripleo-heat-templates (Show other bugs)
Sub Component:
Version:	10.0 (Newton)
Hardware:	Unspecified Unspecified

Priority	unspecified Severity unspecified
Target Milestone:	rc
Target Release:	11.0 (Ocata)
Assigned To:	Karthik Sundaravel
QA Contact:	Yariv
Docs Contact:

URL:
Whiteboard:
Keywords:	TestOnly, Triaged

Depends On:
Blocks:	1406865
	Show dependency tree / graph

Reported:	2016-12-05 06:43 EST by Karthik Sundaravel
Modified:	2017-05-17 15:49 EDT (History)
CC List:	11 users (show)

See Also:
Fixed In Version:	openstack-tripleo-heat-templates-6.0.0-7.el7ost
Doc Type:	If docs needed, set a value
Doc Text:
Story Points:	---
Clone Of:
Environment:
Last Closed:	2017-05-17 15:49:43 EDT
Type:	Bug
Regression:	---
Mount Type:	---
Documentation:	---
CRM:
Verified Versions:
Category:	---
oVirt Team:	---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---

Attachments	(Terms of Use)
Add an attachment (proposed patch, testcase, etc.)

External Trackers
Tracker	ID	Priority	Status	Summary	Last Updated
Red Hat Product Errata	RHEA-2017:1245	normal	SHIPPED_LIVE	Red Hat OpenStack Platform 11.0 Bug Fix and Enhancement Advisory	2017-05-17 19:01:50 EDT

Groups: None (edit)

Description Karthik Sundaravel 2016-12-05 06:43:29 EST

Our Nic config for OVS-DPDK in 
a) Compute node.
            -
              type: ovs_user_bridge
              name: br-link
              use_dhcp: false
              addresses:
                -
                  ip_netmask: {get_param: TenantIpSubnet}
              members:
                -
                  type: ovs_dpdk_port
                  name: dpdk0
                  members:
                    -
                      type: interface
                      name: nic4

b) Controller node

            -
              type: ovs_bridge
              name: br-link
              use_dhcp: false
              addresses:
                -
                  ip_netmask: {get_param: TenantIpSubnet}
              members:
                -
                  type: interface
                  name: nic4


The PING test fails (/usr/share/openstack-tripleo-heat-templates/validation-scripts/all-nodes.sh) after first boot during deployment. 
The DPDK params are not set and at this stage, the DPDK interface is in error state and br-link will not have the IP Address, which causes the PING test to fail.

Please note that the DPDK interface will be up only after setting the DPDK OPTIONS in /etc/sysconfig/openvswitch
 (during step 4 of deployment) and restarting the openvswitch.service (in post-install scripts).

If we comment the ping test, then the deployment succeeds.

Comment 1 Karthik Sundaravel 2016-12-05 06:44:41 EST

Dan Sneddon's Comments:

It sounds like we will need some modifications to make this work, I
think any of the following would work:

* Reorder operations so that the DPDK initialization happens before the
ping test, perhaps by moving the setting of /etc/sysconfig/openvswitch
and restarting of the openvswitch service to an earlier step in the
deployment

* Modify the ping test so that it ignores interfaces on DPDK bridges

* Modify os-net-config so that it completes all the actions needed to
make the interface pingable after os-net-config runs

Comment 2 Vijay Chundury 2017-03-02 06:35:24 EST

This scenario can be validated by QA by the document provided by karthik.

https://docs.google.com/a/redhat.com/document/d/1VhpoBcKj5oVZqXUoDPUKh_g43ITUazZcSl-GiJOxYUs/edit?usp=sharing.

Request the QE team to talk to Karthik before testing this scenario to be in sync with the document.

Comment 9 Eyal Dannon 2017-05-03 04:40:47 EDT

Thank you Karthik,

I've verified this bug with OSPd 11, puddle 2017-04-24.2
br-link gets an IP and passes PING test.

Thanks,

Comment 10 errata-xmlrpc 2017-05-17 15:49:43 EDT

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2017:1245

Note You need to log in before you can comment on or make changes to this bug.