Bug 1395743

Summary: Customer concered about memory and elapsed time to generate custom report in global reporting region
Product: Red Hat CloudForms Management Engine Reporter: Thomas Hennessy <thenness>
Component: PerformanceAssignee: Nick LaMuro <nlamuro>
Status: CLOSED CURRENTRELEASE QA Contact: Jiri Stefanisin <jistefan>
Severity: high Docs Contact:
Priority: high    
Version: 5.6.0CC: cpelland, dmetzger, gtanzill, jdeubel, jhardy, jocarter, jrafanie, kbrock, myoder, nlamuro, obarenbo, saali, simaishi, thenness
Target Milestone: GAKeywords: TestOnly, ZStream
Target Release: 5.8.0   
Hardware: x86_64   
OS: Linux   
Whiteboard: report
Fixed In Version: 5.8.0.0 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of:
: 1417662 1422647 (view as bug list) Environment:
Last Closed: 2017-06-12 17:20:03 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1417662, 1422647    
Attachments:
Description Flags
exported yaml file of custom report consuming too much time and resource none

Description Thomas Hennessy 2016-11-16 15:01:16 UTC 
Created attachment 1221245 [details]
exported yaml file of custom report consuming too much time and resource

Description of problem:Customer has created a specific report to execute in their global VMDB which is intended to report on entire estate of VMs in the environment.  It has been necessary to increase the memory_threshold significantly (from 600 MB to 2500MB) and to increase the reporting timeout value from 3600 seconds to 7200 seconds to allow the report to reliably complete.


Version-Release number of selected component (if applicable):5.6.1.2


How reproducible:need to run specic report (ymal file attached) in an environment with > 25k VMs.


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:
Comment 11 Keenan Brock 2016-11-22 15:49:39 UTC 
PR used (of many)
https://github.com/ManageIQ/manageiq/pull/12733
Comment 16 Keenan Brock 2016-11-30 05:28:31 UTC 
PR: https://github.com/ManageIQ/manageiq/pull/12911
Comment 21 Nick LaMuro 2017-02-15 16:51:07 UTC 
This has mostly been addressed in the cloned BZ:  https://bugzilla.redhat.com/show_bug.cgi?id=1417662

But these are the PRs that have been merged and will be made available in both 5.7 and 5.8:

https://github.com/ManageIQ/manageiq/pull/12972
https://github.com/ManageIQ/manageiq/pull/13700
https://github.com/ManageIQ/manageiq/pull/13101


With the 3 of these in place, we should expect to see the report generate 90% faster, and with a much lower memory footprint (less is being downloaded from the database, resulting in both speed and memory efficiency).
Comment 24 Thomas Hennessy 2017-04-27 14:02:22 UTC 
the original backup file is being restored to the originally indicated location.  As before, it is still about 12 GB.  The restore should be complete by 11:00 AM April 27,2017.

location: http://file.rdu.redhat.com/~thenness/SF-01738251-db