Bug 1395743 - Customer concered about memory and elapsed time to generate custom report in global reporting region
Summary: Customer concered about memory and elapsed time to generate custom report in ...
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Red Hat CloudForms Management Engine
Classification: Red Hat
Component: Performance
Version: 5.6.0
Hardware: x86_64
OS: Linux
high
high
Target Milestone: GA
: 5.8.0
Assignee: Nick LaMuro
QA Contact: Jiri Stefanisin
URL:
Whiteboard: report
Depends On:
Blocks: 1417662 1422647
TreeView+ depends on / blocked
 
Reported: 2016-11-16 15:01 UTC by Thomas Hennessy
Modified: 2020-06-11 13:05 UTC (History)
14 users (show)

Fixed In Version: 5.8.0.0
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
: 1417662 1422647 (view as bug list)
Environment:
Last Closed: 2017-06-12 17:20:03 UTC
Category: ---
Cloudforms Team: ---
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)
exported yaml file of custom report consuming too much time and resource (3.09 KB, text/x-vhdl)
2016-11-16 15:01 UTC, Thomas Hennessy
no flags Details

Description Thomas Hennessy 2016-11-16 15:01:16 UTC
Created attachment 1221245 [details]
exported yaml file of custom report consuming too much time and resource

Description of problem:Customer has created a specific report to execute in their global VMDB which is intended to report on entire estate of VMs in the environment.  It has been necessary to increase the memory_threshold significantly (from 600 MB to 2500MB) and to increase the reporting timeout value from 3600 seconds to 7200 seconds to allow the report to reliably complete.


Version-Release number of selected component (if applicable):5.6.1.2


How reproducible:need to run specic report (ymal file attached) in an environment with > 25k VMs.


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

Comment 11 Keenan Brock 2016-11-22 15:49:39 UTC
PR used (of many)
https://github.com/ManageIQ/manageiq/pull/12733

Comment 16 Keenan Brock 2016-11-30 05:28:31 UTC
PR: https://github.com/ManageIQ/manageiq/pull/12911

Comment 21 Nick LaMuro 2017-02-15 16:51:07 UTC
This has mostly been addressed in the cloned BZ:  https://bugzilla.redhat.com/show_bug.cgi?id=1417662

But these are the PRs that have been merged and will be made available in both 5.7 and 5.8:

https://github.com/ManageIQ/manageiq/pull/12972
https://github.com/ManageIQ/manageiq/pull/13700
https://github.com/ManageIQ/manageiq/pull/13101


With the 3 of these in place, we should expect to see the report generate 90% faster, and with a much lower memory footprint (less is being downloaded from the database, resulting in both speed and memory efficiency).

Comment 24 Thomas Hennessy 2017-04-27 14:02:22 UTC
the original backup file is being restored to the originally indicated location.  As before, it is still about 12 GB.  The restore should be complete by 11:00 AM April 27,2017.

location: http://file.rdu.redhat.com/~thenness/SF-01738251-db


Note You need to log in before you can comment on or make changes to this bug.