Bug 1718102 - services data takes too long to load and often times out
Summary: services data takes too long to load and often times out
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Red Hat CloudForms Management Engine
Classification: Red Hat
Component: UI - Service
Version: 5.10.0
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: GA
: 5.11.0
Assignee: Keenan Brock
QA Contact: Niyaz Akhtar Ansari
Red Hat CloudForms Documentation
URL:
Whiteboard:
Depends On:
Blocks: 1718898 1741327
TreeView+ depends on / blocked
 
Reported: 2019-06-06 21:44 UTC by Keenan Brock
Modified: 2019-12-13 14:57 UTC (History)
7 users (show)

Fixed In Version: 5.11.0.23
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
: 1718898 1741327 (view as bug list)
Environment:
Last Closed: 2019-12-13 14:57:27 UTC
Category: Bug
Cloudforms Team: CFME Core
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)
no svc tree (254.28 KB, image/png)
2019-08-21 09:57 UTC, Jaroslav Henner
no flags Details

Description Keenan Brock 2019-06-06 21:44:27 UTC
Description of problem:

The services explorer displays a tree view on the left hand side and the paginated list of services on the right.

We did backport a fix that makes the left hand tree view responsive.
We have not yet backported a fix to make the services list quick.
The `report_data` query that loads the right hand side is taking minutes instead of a few seconds.

You may get a timeout (meaning it took a really really long time) or you will notice that it took a few minutes.


Version-Release number of selected component (if applicable):

visible in 5.10.33

How reproducible:

Every time if the customer has enough services defined. Probably close to 3,000

Steps to Reproduce:
1. load a high number of servies
2. visit the services/explorer with a list of services

Actual results:

It takes too long to load and often times out.

Expected results:

The page should load in less than 10 seconds

Additional info:

This was seen in https://bugzilla.redhat.com/show_bug.cgi?id=1686433 but the same basic bug rear's it's head every few months. The previous solution was to have the customer one off tweak the product/views/Service.yaml file. This BZ is here to change that decision and apply that fix to all customer's service views.

Comment 3 Sudhir Mallamprabhakara 2019-06-10 02:53:30 UTC
Assigning this to Jaroslav based on https://bugzilla.redhat.com/show_bug.cgi?id=1688937#c14

Comment 5 Jaroslav Henner 2019-07-02 11:22:43 UTC
Works.

Comment 6 Jaroslav Henner 2019-07-03 16:10:42 UTC
Wait. I got confused. This isn't the same issue as 1686433

Comment 7 Satoe Imaishi 2019-07-08 20:38:45 UTC
https://github.com/ManageIQ/manageiq-ui-classic/pull/5366 was reverted in https://github.com/ManageIQ/manageiq-ui-classic/pull/5768, so putting back to ON_DEV

Comment 8 Keenan Brock 2019-07-24 15:59:25 UTC
this was rolled back for 2 reasons:

1. the order was broken         https://github.com/ManageIQ/manageiq/pull/18928
2. the distinct was forgotten   https://github.com/ManageIQ/manageiq/pull/19025

Comment 9 Keenan Brock 2019-08-08 21:38:53 UTC
Testig steps

In the settings flag enable use_sql_view:

:reporting:
  :use_sql_view: true

The settings page (and vms page) should be much faster
The number of records in the settings page should be the same
it should still sort properly

This is necessary for larger databases

Comment 10 CFME Bot 2019-08-08 22:01:09 UTC
New commit detected on ManageIQ/manageiq/ivanchuk:

https://github.com/ManageIQ/manageiq/commit/6ff1fc0c25fd11e392ca4d94c10a8b0b40e992b7
commit 6ff1fc0c25fd11e392ca4d94c10a8b0b40e992b7
Author:     Gregg Tanzillo <gtanzill>
AuthorDate: Thu Aug  8 16:17:59 2019 -0400
Commit:     Gregg Tanzillo <gtanzill>
CommitDate: Thu Aug  8 16:17:59 2019 -0400

    Merge pull request #19025 from kbrock/turbo_distinct

    Turbo distinct

    (cherry picked from commit ec3a2dcce6498c146c12d0384e9b07be0f33f7eb)

    https://bugzilla.redhat.com/show_bug.cgi?id=1718102

 app/models/miq_report.rb | 2 +-
 config/settings.yml | 1 +
 lib/rbac/filterer.rb | 46 +-
 spec/lib/rbac/filterer_spec.rb | 98 +
 4 files changed, 138 insertions(+), 9 deletions(-)

Comment 13 Jaroslav Henner 2019-08-21 09:54:54 UTC
My automation test started failing on that the services tree doesn't contain items. It looks like it happens in Chrome, but not in Firefox.

Comment 14 Jaroslav Henner 2019-08-21 09:57:12 UTC
Created attachment 1606452 [details]
no svc tree

Comment 15 Keenan Brock 2019-08-27 21:27:10 UTC
Turning use sql view on for 5.9 and 5.10 will fix the right hand side:
https://github.com/ManageIQ/manageiq-ui-classic/pull/6101

This was merged Mon 2019-08-26

I'm unsure when the commit to fix the left hand nav bar was merged.
But it was improved for performance.

Comment 16 Keenan Brock 2019-08-27 21:54:32 UTC
The right hand side should be all set and was merged/backported to I/H

H: https://github.com/ManageIQ/manageiq-ui-classic/pull/5785
I?: https://github.com/ManageIQ/manageiq-ui-classic/pull/5686 (Merged to master July 10)

Comment 17 Keenan Brock 2019-08-27 22:55:32 UTC
sorry, I mistyped comment 16.

It should read, the left hand side should be all set.

It was resolved in https://bugzilla.redhat.com/show_bug.cgi?id=1727443

Comment 21 CFME Bot 2019-09-03 19:21:18 UTC
New commit detected on ManageIQ/manageiq-ui-classic/ivanchuk:

https://github.com/ManageIQ/manageiq-ui-classic/commit/08d05c975c8e0596e254c2a627d801d9ce6876b9
commit 08d05c975c8e0596e254c2a627d801d9ce6876b9
Author:     Milan Zázrivec <mzazrivec>
AuthorDate: Tue Aug 27 04:10:12 2019 -0400
Commit:     Milan Zázrivec <mzazrivec>
CommitDate: Tue Aug 27 04:10:12 2019 -0400

    Merge pull request #6101 from kbrock/turbo_services

    Turbo mode for services

    (cherry picked from commit 38a59e54dfd03f0934b776324226e07c8cd1193e)

    https://bugzilla.redhat.com/show_bug.cgi?id=1718102

 product/views/Service.yaml | 3 +
 1 file changed, 3 insertions(+)

Comment 23 Niyaz Akhtar Ansari 2019-09-06 11:36:19 UTC
Verified in Version 5.11.0.23.20190904213640_d113674


Note You need to log in before you can comment on or make changes to this bug.