Bug 1265332

Summary:	CloudForms does not delete old RabbitMQ Queues
Product:	Red Hat CloudForms Management Engine	Reporter:	Chris Pelland <cpelland>
Component:	Providers	Assignee:	Greg Blomquist <gblomqui>
Status:	CLOSED WONTFIX	QA Contact:	Nandini Chandra <nachandr>
Severity:	unspecified	Docs Contact:
Priority:	medium
Version:	5.3.0	CC:	cpelland, dajohnso, gblomqui, jfrey, jhardy, jprause, mfeifer, obarenbo
Target Milestone:	GA	Keywords:	ZStream
Target Release:	5.4.6
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:	openstack
Fixed In Version:		Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:	1265289	Environment:
Last Closed:	2016-05-27 23:47:11 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:	1265289, 1265335
Bug Blocks:

Description Chris Pelland 2015-09-22 16:55:23 UTC

+++ This bug was initially created as a clone of Bug #1265289 +++

When CFME disconnects from the RabbitMQ service, it leaves behind queues that are still bound to exchanges.  The major problem with leaving behind the queues is that the queues will continue to receive messages and this causes the RabbitMQ process to consume memory unbounded until it dies unexpectedly.

How to reproduce:

0. Install the RabbitMQ Management Plugin:  https://www.rabbitmq.com/management.html on an OpenStack environment. (Double check it's not installed first)
1. Add CFME to the OpenStack environment, wait for the event catcher worker to fully start
2. Browse to RabbitMQ Management web ui (http://openstack_ip:15672), login with Rabbit credentials, click the "Queues" tab, look for queues named "miq-<cfme-ip_address>"
  * miq-<cfme-ip_address>-cinder
  * miq-<cfme-ip_address>-glance
  * miq-<cfme-ip_address>-nova
  * miq-<cfme-ip_address>-quantum
3. Disconnect CFME from OpenStack environment (remove provider from CFME)
4. Browse to RabbitMQ Management web ui and look for queues named "miq-<cfme-ip_adddress>"

Expected Results:

There should be no queues called:  "miq-<cfme-ip_address>"

Actual Results:

There are four queues remaining called:
  * miq-<cfme-ip_address>-cinder
  * miq-<cfme-ip_address>-glance
  * miq-<cfme-ip_address>-nova
  * miq-<cfme-ip_address>-quantum

--- Additional comment from Greg Blomquist on 2015-09-22 11:01:53 EDT ---

For CFME 5.3 and earlier, the queue that's left behind is actually called "notifications.*".  That's a literal "notifications.*".  Note that there are openstack-specific queues called "notifications.info" and "notifications.error" that will remain after CFME is disconnected.

After this bug is fixed, when there is no CFME connected to an openstack environment, there should be no queues called:

  * miq-<cfme-ip_address>-cinder
  * miq-<cfme-ip_address>-glance
  * miq-<cfme-ip_address>-nova
  * miq-<cfme-ip_address>-quantum
  * notifications.*

Comment 1 Greg Blomquist 2015-09-28 14:14:35 UTC

http://gitlab.cloudforms.lab.eng.rdu2.redhat.com/cloudforms/cfme/merge_requests/269

Comment 3 Nandini Chandra 2015-10-06 22:39:28 UTC

Tested 5.4.3

After removing an Openstack env(rhos6) from CFME,these queues still exist.

  * miq-<cfme-ip_address>-cinder
  * miq-<cfme-ip_address>-glance
  * miq-<cfme-ip_address>-nova
  * miq-<cfme-ip_address>-quantum

Comment 9 Greg Blomquist 2016-05-27 23:47:11 UTC

Closing this since we're moving to using Ceilometer for collecting events.