Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 873187

Summary:	If QPID is down Quantum (service and agents) are unable to reconnect
Product:	Red Hat OpenStack	Reporter:	Gary Kotton <gkotton>
Component:	openstack-quantum	Assignee:	Gary Kotton <gkotton>
Status:	CLOSED ERRATA	QA Contact:	Nir Magnezi <nmagnezi>
Severity:	urgent	Docs Contact:
Priority:	urgent
Version:	2.0 (Folsom)	CC:	apevec, cpelland, pbrady
Target Milestone:	---
Target Release:	2.1
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:	openstack-quantum-2012.2.1-1.el6ost	Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2012-12-11 13:08:20 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Gary Kotton 2012-11-05 10:08:41 UTC

Description of problem:
If a Quantum service starts before the QPIDD service (or starts and the QPIDD service is down) then the Quantum service is unable to connect to QPID when then QPIDD service restarts.

Version-Release number of selected component (if applicable):
Folsom for Quantum

How reproducible:
100%


Steps to Reproduce:
1. Install Quantum packages and start services
2. Install QPID and start service
3. Reboot

Another way is as follows:
1. Stop QPID
2. Start Quantum service
3. Start QPIDD

In both cases the quantum service will not start (this is easily verified by checking if port 9696 is open)
  
Actual results:
The self.connection.open() call hangs. Unable to access Quantum service.

Expected results:



Additional info:
When the eventlet.monkey_patch() is removed then the reconnects are present in the log file.

Comment 1 Pádraig Brady 2012-11-05 16:53:04 UTC

Assigning to Gary since he's been looking at this mostly.
Also noting that nova network service (I think) is also experiencing this according to Gary. Also Russell is unable to reproduce.

Comment 4 Alan Pevec 2012-11-08 20:18:41 UTC

Proposed patch upstream (under review) https://review.openstack.org/#/c/15663/

Comment 7 Gary Kotton 2012-11-13 14:38:59 UTC

Update:
1. Patch has been approved upstream
2. Patch is now in review for stable/folsom

Comment 8 Gary Kotton 2012-11-22 10:51:57 UTC

The fix is ready and pending packaging.
Thanks
Gary

Comment 11 errata-xmlrpc 2012-12-11 13:08:20 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

http://rhn.redhat.com/errata/RHBA-2012-1561.html