Bug 1348625
| Summary: | We might not be purging all tables that we should be | |||
|---|---|---|---|---|
| Product: | Red Hat CloudForms Management Engine | Reporter: | Joe Rafaniello <jrafanie> | |
| Component: | Performance | Assignee: | Keenan Brock <kbrock> | |
| Status: | CLOSED CURRENTRELEASE | QA Contact: | Tasos Papaioannou <tpapaioa> | |
| Severity: | medium | Docs Contact: | ||
| Priority: | high | |||
| Version: | 5.5.0 | CC: | cpelland, dmetzger, jhardy, nachandr, obarenbo, tpapaioa | |
| Target Milestone: | GA | Keywords: | TestOnly, ZStream | |
| Target Release: | 5.8.0 | |||
| Hardware: | Unspecified | |||
| OS: | Unspecified | |||
| Whiteboard: | perf:database | |||
| Fixed In Version: | 5.8.0.0 | Doc Type: | If docs needed, set a value | |
| Doc Text: | Story Points: | --- | ||
| Clone Of: | ||||
| : | 1410846 1412448 (view as bug list) | Environment: | ||
| Last Closed: | 2017-06-12 16:09:22 UTC | Type: | Bug | |
| Regression: | --- | Mount Type: | --- | |
| Documentation: | --- | CRM: | ||
| Verified Versions: | Category: | --- | ||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | ||
| Cloudforms Team: | --- | Target Upstream Version: | ||
| Embargoed: | ||||
| Bug Depends On: | ||||
| Bug Blocks: | 1410846, 1412448 | |||
|
Comment 3
Joe Rafaniello
2016-10-07 20:54:44 UTC
I got the following information. | relation | size mb | rows | |:---------------------------------------------------------|--------:|------: | | **event_streams** | 8,934 | 6,933,269 | | event_streams_pkey | 149 | | | index_event_streams_on_chain_id_and_ems_id | 209 | | | index_event_streams_on_dest_host_id | 149 | | | index_event_streams_on_dest_vm_or_template_id | 149 | | | index_event_streams_on_ems_cluster_id | 149 | | | index_event_streams_on_ems_id | 149 | | | index_event_streams_on_event_type | 359 | | | index_event_streams_on_host_id | 149 | | | index_event_streams_on_timestamp | 149 | | | index_event_streams_on_vm_or_template_id | 149 | | | **miq_report_result_details** | 5,582 | 18,383,604 | | miq_report_result_details_idx | 712 | | | miq_report_result_details_pkey | 394 | | | **miq_report_results** | 47 | 27,841 | | **audit_events** | 1,078 | 6,725,715 | | audit_events_pkey | 144 | | | index_audit_events_on_target_id_and_target_class | 145 | | | **vmdb_metrics** | 937 | 6,013,446 | | vmdb_metrics_pkey | 129 | | | **advanced_settings** | 312 | 1,738,917 | | index_advanced_settings_on_resource_id_and_resource_type | 54 | | | index_vmdb_metrics_on_resource_and_timestamp | 285 | | | **guest_applications** | 493 | 1,378,972 | | index_guest_applications_on_typename | 58 | | heh. oops. table was markdown centric EventStreams: https://github.com/ManageIQ/manageiq/pull/11813 New commit detected on ManageIQ/manageiq/euwe: https://github.com/ManageIQ/manageiq/commit/f915117f045f9e2308428cb1b03d921bae5a6b7b commit f915117f045f9e2308428cb1b03d921bae5a6b7b Author: Jason Frey <fryguy9> AuthorDate: Tue Oct 11 18:19:43 2016 -0400 Commit: Oleg Barenboim <chessbyte> CommitDate: Thu Oct 13 16:45:04 2016 -0400 Merge pull request #11813 from kbrock/prune_system_events Prune all EventStream events (cherry picked from commit a9497c3d792341e1c81113a7a071e634a92bdc03) https://bugzilla.redhat.com/show_bug.cgi?id=1348625 app/models/ems_event.rb | 44 -------------------------- app/models/event_stream.rb | 44 ++++++++++++++++++++++++++ app/models/miq_schedule_worker/jobs.rb | 2 +- spec/models/miq_schedule_worker/runner_spec.rb | 2 +- 4 files changed, 46 insertions(+), 46 deletions(-) New commit detected on ManageIQ/manageiq/master: https://github.com/ManageIQ/manageiq/commit/f84a42594a446a92ce04fe7c7829ac598ed5ae9d commit f84a42594a446a92ce04fe7c7829ac598ed5ae9d Author: Keenan Brock <kbrock> AuthorDate: Thu Dec 8 16:48:43 2016 -0500 Commit: Keenan Brock <kbrock> CommitDate: Fri Dec 9 16:02:10 2016 -0500 Introduce purge timer for drift states https://bugzilla.redhat.com/show_bug.cgi?id=1348625 app/models/miq_schedule_worker/jobs.rb | 4 ++++ app/models/miq_schedule_worker/runner.rb | 5 +++++ config/settings.yml | 1 + 3 files changed, 10 insertions(+) New commit detected on ManageIQ/manageiq/master: https://github.com/ManageIQ/manageiq/commit/2f7824930787304c1b77511dfd5cf46f542d0ae8 commit 2f7824930787304c1b77511dfd5cf46f542d0ae8 Author: Keenan Brock <kbrock> AuthorDate: Wed Dec 7 11:11:50 2016 -0500 Commit: Keenan Brock <kbrock> CommitDate: Wed Dec 14 14:11:25 2016 -0500 Introduce report result purging timer The resources required for report result purging has been reduced, so make sure this is scheduled. https://bugzilla.redhat.com/show_bug.cgi?id=1348625 app/models/miq_schedule_worker/jobs.rb | 4 ++++ app/models/miq_schedule_worker/runner.rb | 6 ++++++ config/settings.yml | 1 + 3 files changed, 11 insertions(+) Purging tables in the following PRs event streams: https://github.com/ManageIQ/manageiq/pull/11813 miq_report_results https://github.com/ManageIQ/manageiq/pull/13044 drift_states https://github.com/ManageIQ/manageiq/pull/13086 all on master New commit detected on ManageIQ/manageiq/euwe: https://github.com/ManageIQ/manageiq/commit/5a82e28f3ef52cb9082f2eaaa529e0bf4757dce0 commit 5a82e28f3ef52cb9082f2eaaa529e0bf4757dce0 Author: Keenan Brock <kbrock> AuthorDate: Wed Dec 7 11:11:50 2016 -0500 Commit: Keenan Brock <kbrock> CommitDate: Wed Jan 11 20:26:48 2017 -0500 Introduce report result purging timer The resources required for report result purging has been reduced, so make sure this is scheduled. https://bugzilla.redhat.com/show_bug.cgi?id=1348625 app/models/miq_schedule_worker/jobs.rb | 4 ++++ app/models/miq_schedule_worker/runner.rb | 6 ++++++ config/settings.yml | 1 + 3 files changed, 11 insertions(+) [----] I, [2017-05-19T07:48:23.994536 #63471:985134] INFO -- : MIQ(DriftState.purge_by_date) Purging Drift states older than [2016-11-20 11:48:20 UTC]... [----] I, [2017-05-19T14:35:49.443990 #2923:5c1138] INFO -- : MIQ(EventStream.purge_by_date) Purging Event streams older than [2017-05-19 16:35:44 UTC]... [----] I, [2017-05-19T14:35:49.456240 #2923:5c1138] INFO -- : MIQ(PolicyEvent.purge_by_date) Purging Policy events older than [2017-05-19 16:35:44 UTC]... No ReportResult purge activity in evm.log, even with report_result_purge_interval set to 10.minutes (and server restart). ReportResult purge activity showing up as well: [----] I, [2017-05-19T15:57:21.768484 #2932:112513c] INFO -- : MIQ(MiqReportResult.purge_by_date) Purging Miq report results older than [2016-11-20 19:57:17 UTC]... Verified on 5.8.0.15. |