Bug 1438294

Summary: keystone-manage token_flush isn't running frequently enough and will break on some occasion
Product: Red Hat OpenStack Reporter: David Hill <dhill>
Component: openstack-keystoneAssignee: John Dennis <jdennis>
Status: CLOSED DUPLICATE QA Contact: nlevinki <nlevinki>
Severity: urgent Docs Contact:
Priority: urgent    
Version: 10.0 (Newton)CC: dhill, jdennis, nchandek, nkinder, panbalag, srevivo, vaggarwa
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2017-04-13 15:55:36 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description David Hill 2017-04-02 22:13:15 UTC
Description of problem:
keystone-manage token_flush isn't running frequently enough and will break on some occasion thus accumulating all tokens until a table drop is done because cleaning up those tokens isn't possible any longer.   It should be run hourly or even more frequently.

Version-Release number of selected component (if applicable):


How reproducible:
Always as soon as you have a bit of activity in an environment, daily cleanup will fail

Steps to Reproduce:
1. Get much activity on the cluster
2. Wait a bit until the daily token flush fails
3.

Actual results:
Cleanup fails

Expected results:
Cleanup never fails

Additional info:
I've seen this on RHOSP 10 and RHOSP 9.   Perhaps 9.

Comment 2 David Hill 2017-04-02 22:20:07 UTC
This will make recovering galera database corruption through pacemaker very hard because it will time out while trying to sync 160GB (in this current case).