Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 824512

Summary: Scalability: Component Outlines tab in /conductor/pool_families is slow when there are a large number of images
Product: [Retired] CloudForms Cloud Engine Reporter: Chris Pelland <cpelland>
Component: aeolus-conductorAssignee: Jiri Tomasek <jtomasek>
Status: CLOSED ERRATA QA Contact: Rehana <aeolus-qa-list>
Severity: high Docs Contact:
Priority: unspecified    
Version: 1.0.0CC: akarol, athomas, cpelland, dajohnso, deltacloud-maint, dmacpher, hbrock, morazi, rlandy, rwsu, slinaber, ssachdev, tzumainn
Target Milestone: 1.0.1Keywords: ZStream
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
A large number of images increases the number of queries to Image Warehouse and degrades the "Images" page load time. This update paginates the results in "Images" and reduces the load time.
Story Points: ---
Clone Of: 803106 Environment:
Last Closed: 2012-07-10 07:22:47 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 803106    
Bug Blocks:    
Attachments:
Description Flags
main images list is truncated
none
cloud details shows a lot more images present
none
Images in pages
none
long list images
none
with pagination none

Description Chris Pelland 2012-05-23 16:08:31 UTC
+++ This bug was initially created as a clone of Bug #803106 +++

Description of problem:
It takes about 56 seconds for this page to load when there are 100 images in the system. There are alot of calls to iwhd, so this may be the underlying issue. Perhaps we can paginate the table.

Version-Release number of selected component (if applicable):
aeolus-conductor-0.8.0-42.el6.noarch

How reproducible:
always

Steps to Reproduce:
1. Build 100 images for mock. 
You can use this jmeter test to help with creating multiple images: https://github.com/aeolusproject/aeolus-performance-testing/tree/master/jmeter/build-and-push

Comment 1 Tzu-Mainn Chen 2012-05-29 17:55:05 UTC
1.0.1 patches:

commit 4178f9f320dd99c60c5f4e0501f1d58883d4fc9f
BZ803106 fix the per_page value in images controller (1.0.1 only)

commit a5379491ae68614e8b297a00cc85597d63f215be
BZ803106 added pagination to images list

Comment 2 Dan Macpherson 2012-06-06 02:50:23 UTC
    Technical note added. If any revisions are required, please edit the "Technical Notes" field
    accordingly. All revisions will be proofread by the Engineering Content Services team.
    
    New Contents:
A large number of images increases the number of queries to Image Warehouse and degrades the "Images" page load time. This update paginates the results in "Images" and reduces the load time.

Comment 3 Ronelle Landy 2012-06-12 23:30:37 UTC
Using jmeter testing, I can only get 15 images to show in the /conductor/images page - even though the other images are present and can be accessed by going directly to /conductor/images/image_uuid.

Need to check this further with devel. Is this a new default user setting?

rpms tested:

>> rpm -qa |grep aeolus
aeolus-all-0.8.27-1.el6_3.noarch
aeolus-conductor-doc-0.8.27-1.el6_3.noarch
aeolus-conductor-0.8.27-1.el6_3.noarch
aeolus-configure-2.5.7-1.el6_3.noarch
aeolus-conductor-daemons-0.8.27-1.el6_3.noarch
rubygem-aeolus-image-0.3.0-12.el6.noarch
rubygem-aeolus-cli-0.3.3-1.el6_3.noarch

Comment 4 Dave Johnson 2012-06-13 21:34:24 UTC
Yeah, something is going on with this one and needs to be reopened as well

I'll attach some screen shots

Comment 5 Dave Johnson 2012-06-13 21:38:14 UTC
Created attachment 591642 [details]
main images list is truncated

Comment 6 Dave Johnson 2012-06-13 21:39:04 UTC
Created attachment 591643 [details]
cloud details shows a lot more images present

Comment 8 Tzu-Mainn Chen 2012-06-15 15:11:21 UTC
Reviewed and pushed to 1.0.1:

commit 096e2580f828bc062a1c4ebbecc80198cb7e4565
added pagination to images list

commit bbc39554714576618fc13fc5dd0e6a99c3cce53b
 Fix render_pagination

commit aeb8132da52c1a678e6729cf5f6943cf3050828a
BZ802772: Add pagination to deployments#show
https://bugzilla.redhat.com/show_bug.cgi?id=802772

commit 18c81ac75c3fcf2b4e1397baa58986ab224bfcff
BZ802772: Add pagination to pools#index and pools#show
https://bugzilla.redhat.com/show_bug.cgi?id=802772

Comment 9 Ronelle Landy 2012-06-29 18:27:21 UTC
Tested this BZ by adding 100 images and building/pushing to mock.

There are two different pages to access the images available
/conductor/pool_families/1 (and click on Images link - 100 listed - no pagination) and ...
/conductor/pool_families/ (click on Images link - images are divided in pages)

See attached screenshots ... the second one is properly paginated, but the first is not.


rpms tested

>>  rpm -qa |grep aeolus
aeolus-conductor-daemons-0.8.33-1.el6cf.noarch
aeolus-conductor-0.8.33-1.el6cf.noarch
aeolus-all-0.8.33-1.el6cf.noarch
rubygem-aeolus-image-0.3.0-12.el6.noarch
rubygem-aeolus-cli-0.3.3-2.el6_2.noarch
aeolus-configure-2.5.10-1.el6cf.noarch
aeolus-conductor-doc-0.8.33-1.el6cf.noarch

Comment 10 Ronelle Landy 2012-06-29 18:29:17 UTC
Created attachment 595348 [details]
Images in pages

Comment 11 Ronelle Landy 2012-06-29 18:31:45 UTC
Created attachment 595349 [details]
long list images

Comment 12 Ronelle Landy 2012-06-29 22:03:24 UTC
Verified this BZ now works - has pagination on both /conductor/pool_families/1 and 
/conductor/pool_families/.

Load time is appropriately reduced - and is approx. the same on each page. Previous, Next, Number links all work.

See attached screenshot

rpms tested: 

>> rpm -qa |grep aeolus
aeolus-conductor-daemons-0.8.34-1.el6cf.noarch
aeolus-conductor-0.8.34-1.el6cf.noarch
rubygem-aeolus-image-0.3.0-12.el6.noarch
aeolus-conductor-doc-0.8.34-1.el6cf.noarch
rubygem-aeolus-cli-0.3.3-2.el6_2.noarch
aeolus-configure-2.5.10-1.el6cf.noarch
aeolus-all-0.8.34-1.el6cf.noarch

Comment 13 Ronelle Landy 2012-06-29 22:04:03 UTC
Created attachment 595375 [details]
with pagination

Comment 15 errata-xmlrpc 2012-07-10 07:22:47 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

http://rhn.redhat.com/errata/RHBA-2012-1063.html