Bug 1002258

Summary: Backport fix for Nicira Neutron Plugin (upstream bug 1204277)
Product: Red Hat OpenStack Reporter: Michael Solberg <msolberg>
Component: openstack-quantumAssignee: Jakub Libosvar <jlibosva>
Status: CLOSED INSUFFICIENT_DATA QA Contact: yeylon <yeylon>
Severity: high Docs Contact:
Priority: high    
Version: 3.0CC: chrisw, dcadzow, dmaley, lpeer, msolberg, oblaut, sputhenp, srevivo, yeylon
Target Milestone: z4Keywords: FeatureBackport, OtherQA, ZStream
Target Release: 3.0Flags: lpeer: needinfo? (msolberg)
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2014-01-22 13:18:53 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Attachments:
Description Flags
Proposed Backport none

Description Michael Solberg 2013-08-28 18:25:52 UTC 
Description of problem:
Customer has run into an issue where the NVP plugin is causing deadlocks on the Quantum database.  Here's the upstream issue:

https://bugs.launchpad.net/neutron/+bug/1204277

Version-Release number of selected component (if applicable):
openstack-quantum

How reproducible:
100%

Steps to Reproduce:
1. Set up RHOS 3 with Nicira plugin.
2. Launch some virtual machines and configure networking.

Actual results:
Quantum database queries get slow - like up to 1 min.


Expected results:
Quantum database queries should be sub-second.
Comment 1 Michael Solberg 2013-08-28 18:28:38 UTC 
Created attachment 791503 [details]
Proposed Backport

This backport has only been smoke-tested.  It was modified a fair amount from the upstream backport.
Comment 4 Michael Solberg 2013-08-30 18:50:29 UTC 
We did some testing this afternoon.  This patch introduces a bug where routers aren't deleted properly from the environment.  Please do not use.
Comment 7 lpeer 2013-11-11 17:24:40 UTC 
Ofer - could you please verify that the backporting did not cause any regressions, the scratch build to test is specify in comment #6.
Comment 8 Rami Vaknin 2013-11-15 10:35:03 UTC 
(In reply to lpeer from comment #7)
> Ofer - could you please verify that the backporting did not cause any
> regressions, the scratch build to test is specify in comment #6.

Done - I've install the following packages on clean rhel 6.5 and then installed Grizzly/2013-11-14.2 ran my auto-test, all passed successfully:

http://download.devel.redhat.com/brewroot/work/tasks/6259/6556259/openstack-quantum-nicira-2013.1.4-rhbz1002258.el6ost.noarch.rpm

http://download.devel.redhat.com/brewroot/work/tasks/6259/6556259/openstack-quantum-2013.1.4-rhbz1002258.el6ost.noarch.rpm

http://download.devel.redhat.com/brewroot/work/tasks/6259/6556259/python-quantum-2013.1.4-rhbz1002258.el6ost.noarch.rpm
Comment 9 lpeer 2013-12-24 07:03:26 UTC 
Michael, we backported the fix and QE tested that there are no regressions.
We do not have access to setup with the required software (NVP/NSX plugin), who  can verify the bug?
Comment 11 Scott Lewis 2014-01-21 19:59:04 UTC 
Adding >=POST to next async release
Comment 12 lpeer 2014-01-22 13:18:53 UTC 
The patch with the backport and a scratch build was attached we did not get any feedback on the patch.
If we want this fix we need someone to verify it.
Comment 13 Dave Maley 2014-01-22 18:17:27 UTC 
The customer found a temporary workaround by disabling the metadata service and believes the issue will go away when they move to Havana, and thus they closed the ticket.