Bug 1319793

Summary: Large heat stack creates get longer, heat purge_deleted fails to work
Product: Red Hat OpenStack Reporter: Jeremy <jmelvin>
Component: openstack-heatAssignee: Zane Bitter <zbitter>
Status: CLOSED INSUFFICIENT_DATA QA Contact: Amit Ugol <augol>
Severity: medium Docs Contact:
Priority: medium    
Version: 7.0 (Kilo)CC: jmelvin, mburns, rhel-osp-director-maint, sbaker, shardy, srevivo
Target Milestone: ---Keywords: Unconfirmed, ZStream
Target Release: 7.0 (Kilo)Flags: zbitter: needinfo? (jmelvin)
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-07-27 21:14:08 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Jeremy 2016-03-21 14:25:15 UTC
Description of problem: Large heat stack creates get progressively longer, It seems the DB needs to be cleaned. However heat purge_deleted fails to work.

stack create seems to get longer as the db fills up. heat-manage purge_deleted should purge the db but the command fails :
[root@slnec2ctl2 log]# heat-manage --debug -v purge_deleted -g days 1
2016-03-08 10:16:08.836 9254 ERROR oslo_db.sqlalchemy.exc_filters [-] DB
exception wrapped.
2016-03-08 10:16:08.836 9254 TRACE oslo_db.sqlalchemy.exc_filters Traceback
(most recent call last):
2016-03-08 10:16:08.836 9254 TRACE oslo_db.sqlalchemy.exc_filters   File
"/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 316,
in connection
2016-03-08 10:16:08.836 9254 TRACE oslo_db.sqlalchemy.exc_filters
return self._revalidate_connection()
2016-03-08 10:16:08.836 9254 TRACE oslo_db.sqlalchemy.exc_filters   File
"/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 396,
in _revalidate_connection
2016-03-08 10:16:08.836 9254 TRACE oslo_db.sqlalchemy.exc_filters     raise
exc.ResourceClosedError("This Connection is closed")
2016-03-08 10:16:08.836 9254 TRACE oslo_db.sqlalchemy.exc_filters
ResourceClosedError: This Connection is closed
2016-03-08 10:16:08.836 9254 TRACE oslo_db.sqlalchemy.exc_filters
ERROR: This Connection is closed


Version-Release number of selected component (if applicable):
openstack-heat-api-2015.1.2-6.el7ost.noarch

How reproducible:


Steps to Reproduce:
1.create several large heat stacks
2.attempt to purge DB
3.

Actual results:
fails with errros above

Expected results:
DB should be cleaned

Additional info:

Comment 2 Zane Bitter 2016-03-21 14:44:18 UTC
The code for purging the database was largely rewritten in 2015.1.2-9, so I recommend updating to that and trying again before anything else.