Bug 1566468 - [RHV] When Graph refresh is ON, RHV provider refresh time is longer
Summary: [RHV] When Graph refresh is ON, RHV provider refresh time is longer
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Red Hat CloudForms Management Engine
Classification: Red Hat
Component: Providers
Version: 5.9.0
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: GA
: 5.10.0
Assignee: Boriso
QA Contact: Angelina Vasileva
URL:
Whiteboard: rhev:graph refresh
Depends On:
Blocks: 1532255 1578996
TreeView+ depends on / blocked
 
Reported: 2018-04-12 11:34 UTC by Ilanit Stein
Modified: 2019-08-01 13:04 UTC (History)
8 users (show)

Fixed In Version: 5.10.0.0
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
: 1578996 (view as bug list)
Environment:
Last Closed: 2019-02-11 14:02:07 UTC
Category: Bug
Cloudforms Team: RHEVM
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)
cfme_graph_refresh_on_evm.log (4.72 MB, application/x-gzip)
2018-04-12 11:36 UTC, Ilanit Stein
no flags Details
cfme_graph_refresh_on_automationlog (2.08 MB, application/x-gzip)
2018-04-12 11:36 UTC, Ilanit Stein
no flags Details
cfme_graph_refresh_on_production.log (28.34 KB, application/x-gzip)
2018-04-12 11:37 UTC, Ilanit Stein
no flags Details
cfme_graph_refresh_off_evm.log (8.05 MB, application/x-gzip)
2018-04-12 11:43 UTC, Ilanit Stein
no flags Details
cfme_graph_refresh_off_automation.log (3.75 MB, application/x-gzip)
2018-04-12 11:44 UTC, Ilanit Stein
no flags Details
cfme_graph_refresh_off_production.log (58.63 KB, application/x-gzip)
2018-04-12 11:44 UTC, Ilanit Stein
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Github ManageIQ manageiq-providers-ovirt pull 237 0 None None None 2018-05-14 08:52:21 UTC

Description Ilanit Stein 2018-04-12 11:34:21 UTC
Description of problem:
On CFME-5.9.2.0 (Graph refresh set to ON by default) save inventory for a scale RHV provider, takes LONGER time than for CFME-5.9.2.0 with Graph refresh set to OFF. 
It should be the opposite.

Graph refresh ON:
================
1st refresh 13 min
2nd refresh 13.5 min

Graph refresh OFF:
=================
1st refresh 6 min
2nd refresh 5 min

Scale RHV details:
=================
4032 Virtual Machines
6 Data Storage Domains
405 Hosts
6 Clusters
8 Data Centers

* CFME & RHV both located in the US (no latency)

Version-Release number of selected component (if applicable):
CFME-5.9.2.0
RHV-4.2.2.4-0.1.el7

Comment 2 Ilanit Stein 2018-04-12 11:36:06 UTC
Created attachment 1420813 [details]
cfme_graph_refresh_on_evm.log

Comment 3 Ilanit Stein 2018-04-12 11:36:43 UTC
Created attachment 1420814 [details]
cfme_graph_refresh_on_automationlog

Comment 4 Ilanit Stein 2018-04-12 11:37:16 UTC
Created attachment 1420815 [details]
cfme_graph_refresh_on_production.log

Comment 5 Ilanit Stein 2018-04-12 11:43:25 UTC
Created attachment 1420816 [details]
cfme_graph_refresh_off_evm.log

Comment 6 Ilanit Stein 2018-04-12 11:44:15 UTC
Created attachment 1420817 [details]
cfme_graph_refresh_off_automation.log

Comment 7 Ilanit Stein 2018-04-12 11:44:50 UTC
Created attachment 1420818 [details]
cfme_graph_refresh_off_production.log

Comment 11 CFME Bot 2018-05-14 08:39:24 UTC
New commit detected on ManageIQ/manageiq-providers-ovirt/master:

https://github.com/ManageIQ/manageiq-providers-ovirt/commit/94de71e586d0a3e652c061f47a772cb6da4ec915
commit 94de71e586d0a3e652c061f47a772cb6da4ec915
Author:     Boris Odnopozov <bodnopoz>
AuthorDate: Thu May 10 08:25:35 2018 -0400
Commit:     Boris Odnopozov <bodnopoz>
CommitDate: Thu May 10 08:25:35 2018 -0400

    Performance improvements for graph refresh

    Added spec for scale.
    Add a fix for custom saving block (suggested by Ladas)

    Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1566468

 app/models/manageiq/providers/redhat/inventory_collection_default/infra_manager.rb | 6 +-
 spec/models/manageiq/providers/redhat/infra_manager/refresh/refresh_recording_modifier_spec.rb | 58 +
 spec/models/manageiq/providers/redhat/infra_manager/refresh/refresher_huge_async_spec.rb | 141 +
 spec/support/modify_refresh_yml_recording.rb | 214 +
 spec/vcr_cassettes/manageiq/providers/redhat/infra_manager/refresh/ovirt_sdk_refresh_recording_for_mod.yml | 2819 +
 5 files changed, 3236 insertions(+), 2 deletions(-)

Comment 12 Boriso 2018-05-16 18:24:12 UTC
Note this pr is also required:
https://github.com/ManageIQ/manageiq-providers-ovirt/pull/240

Comment 14 Ilanit Stein 2018-09-20 09:40:25 UTC
Verified on: CFME-5.10.0.16/RHV-4.2.6-4

RHV Details:
===========
5 Data Centers
5 Clusters
400 Hosts
10 Data Storage Domains
3630 Virtual Machines


CFME 1: Graph Refresh: ON (by default)
======================================
RHV 1st Refresh: 7 min
RHV Removal: 17 min
RHV 2nd Refresh: 7 min
RHV Removal: Less than 1 minute

CFME 2: Graph Refresh: OFF (Turned OFF Before adding RHV)
=========================================================
RHV 1st Refresh: 9 min
RHV Removal: 11 min
RHV 2nd Refresh: 8 min
RHV Removal: Less than 1 minute


Note You need to log in before you can comment on or make changes to this bug.