Bugzilla will be upgraded to version 5.0. The upgrade date is tentatively scheduled for 2 December 2018, pending final testing and feedback.
Bug 1350962 - db:migrate on large database takes long time and large amount of memory
db:migrate on large database takes long time and large amount of memory
Status: CLOSED ERRATA
Product: Red Hat CloudForms Management Engine
Classification: Red Hat
Component: Performance (Show other bugs)
5.4.0
Unspecified Unspecified
high Severity high
: GA
: 5.5.5
Assigned To: Jason Frey
Alex Krzos
: ZStream
Depends On: 1337159
Blocks:
  Show dependency treegraph
 
Reported: 2016-06-28 16:42 EDT by John Prause
Modified: 2016-07-26 11:36 EDT (History)
11 users (show)

See Also:
Fixed In Version: 5.5.5.2
Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: 1337159
Environment:
Last Closed: 2016-07-26 11:36:10 EDT
Type: ---
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---


Attachments (Terms of Use)
Files from migration on 5552 (86.20 KB, application/zip)
2016-07-19 08:10 EDT, Alex Krzos
no flags Details


External Trackers
Tracker ID Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2016:1488 normal SHIPPED_LIVE CFME 5.5.5 bug fixes and enhancement update 2016-07-26 15:28:27 EDT

  None (edit)
Comment 2 Alex Krzos 2016-07-19 08:08:18 EDT
Testing 5.5.5.2 I see some reduction in timing but the most noticeable savings is in memory utilization:

Peak appliance used memory during rake db:migrate
5.5.4.1 - 11.3GiB
5.5.5.2 - 2.7GiB

db:migrate Timing:
5.5.4.1 - 6hr 45m
5.5.5.2 - 5hr 43m

Database still bloats on event_streams:

event_streams - 17GB


vmdb_production=# SELECT pg_size_pretty(pg_database_size('vmdb_production'));
 pg_size_pretty
----------------
 37 GB
(1 row)

vmdb_production=# VACUUM FULL event_streams;
VACUUM
vmdb_production=# SELECT pg_size_pretty(pg_database_size('vmdb_production'));
 pg_size_pretty
----------------
 26 GB
(1 row)


FixSerializedReportsForRailsFour decreases in timing:
5.5.4.1 - 21999.6597s
5.5.5.2 - 19057.7571s

As 

RenameEmsEventTableToEventStream increases in timing:
5.5.4.1 - 876.8407s
5.5.5.2 - 1194.6601s

Though net affect on db:migrate is lower by an hour in this testbed.
Comment 4 Alex Krzos 2016-07-19 08:10 EDT
Created attachment 1181613 [details]
Files from migration on 5552
Comment 6 errata-xmlrpc 2016-07-26 11:36:10 EDT
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHBA-2016-1488.html

Note You need to log in before you can comment on or make changes to this bug.