Bug 1566468

Summary: [RHV] When Graph refresh is ON, RHV provider refresh time is longer
Product: Red Hat CloudForms Management Engine Reporter: Ilanit Stein <istein>
Component: ProvidersAssignee: Boriso <bodnopoz>
Status: CLOSED CURRENTRELEASE QA Contact: Angelina Vasileva <anikifor>
Severity: high Docs Contact:
Priority: high    
Version: 5.9.0CC: bodnopoz, cpelland, gblomqui, jfrey, jhardy, jprause, mperina, obarenbo
Target Milestone: GAKeywords: TestOnly, ZStream
Target Release: 5.10.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard: rhev:graph refresh
Fixed In Version: 5.10.0.0 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of:
: 1578996 (view as bug list) Environment:
Last Closed: 2019-02-11 14:02:07 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: Bug
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: RHEVM Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1532255, 1578996    
Attachments:
Description Flags
cfme_graph_refresh_on_evm.log
none
cfme_graph_refresh_on_automationlog
none
cfme_graph_refresh_on_production.log
none
cfme_graph_refresh_off_evm.log
none
cfme_graph_refresh_off_automation.log
none
cfme_graph_refresh_off_production.log none

Description Ilanit Stein 2018-04-12 11:34:21 UTC
Description of problem:
On CFME-5.9.2.0 (Graph refresh set to ON by default) save inventory for a scale RHV provider, takes LONGER time than for CFME-5.9.2.0 with Graph refresh set to OFF. 
It should be the opposite.

Graph refresh ON:
================
1st refresh 13 min
2nd refresh 13.5 min

Graph refresh OFF:
=================
1st refresh 6 min
2nd refresh 5 min

Scale RHV details:
=================
4032 Virtual Machines
6 Data Storage Domains
405 Hosts
6 Clusters
8 Data Centers

* CFME & RHV both located in the US (no latency)

Version-Release number of selected component (if applicable):
CFME-5.9.2.0
RHV-4.2.2.4-0.1.el7

Comment 2 Ilanit Stein 2018-04-12 11:36:06 UTC
Created attachment 1420813 [details]
cfme_graph_refresh_on_evm.log

Comment 3 Ilanit Stein 2018-04-12 11:36:43 UTC
Created attachment 1420814 [details]
cfme_graph_refresh_on_automationlog

Comment 4 Ilanit Stein 2018-04-12 11:37:16 UTC
Created attachment 1420815 [details]
cfme_graph_refresh_on_production.log

Comment 5 Ilanit Stein 2018-04-12 11:43:25 UTC
Created attachment 1420816 [details]
cfme_graph_refresh_off_evm.log

Comment 6 Ilanit Stein 2018-04-12 11:44:15 UTC
Created attachment 1420817 [details]
cfme_graph_refresh_off_automation.log

Comment 7 Ilanit Stein 2018-04-12 11:44:50 UTC
Created attachment 1420818 [details]
cfme_graph_refresh_off_production.log

Comment 11 CFME Bot 2018-05-14 08:39:24 UTC
New commit detected on ManageIQ/manageiq-providers-ovirt/master:

https://github.com/ManageIQ/manageiq-providers-ovirt/commit/94de71e586d0a3e652c061f47a772cb6da4ec915
commit 94de71e586d0a3e652c061f47a772cb6da4ec915
Author:     Boris Odnopozov <bodnopoz>
AuthorDate: Thu May 10 08:25:35 2018 -0400
Commit:     Boris Odnopozov <bodnopoz>
CommitDate: Thu May 10 08:25:35 2018 -0400

    Performance improvements for graph refresh

    Added spec for scale.
    Add a fix for custom saving block (suggested by Ladas)

    Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1566468

 app/models/manageiq/providers/redhat/inventory_collection_default/infra_manager.rb | 6 +-
 spec/models/manageiq/providers/redhat/infra_manager/refresh/refresh_recording_modifier_spec.rb | 58 +
 spec/models/manageiq/providers/redhat/infra_manager/refresh/refresher_huge_async_spec.rb | 141 +
 spec/support/modify_refresh_yml_recording.rb | 214 +
 spec/vcr_cassettes/manageiq/providers/redhat/infra_manager/refresh/ovirt_sdk_refresh_recording_for_mod.yml | 2819 +
 5 files changed, 3236 insertions(+), 2 deletions(-)

Comment 12 Boriso 2018-05-16 18:24:12 UTC
Note this pr is also required:
https://github.com/ManageIQ/manageiq-providers-ovirt/pull/240

Comment 14 Ilanit Stein 2018-09-20 09:40:25 UTC
Verified on: CFME-5.10.0.16/RHV-4.2.6-4

RHV Details:
===========
5 Data Centers
5 Clusters
400 Hosts
10 Data Storage Domains
3630 Virtual Machines


CFME 1: Graph Refresh: ON (by default)
======================================
RHV 1st Refresh: 7 min
RHV Removal: 17 min
RHV 2nd Refresh: 7 min
RHV Removal: Less than 1 minute

CFME 2: Graph Refresh: OFF (Turned OFF Before adding RHV)
=========================================================
RHV 1st Refresh: 9 min
RHV Removal: 11 min
RHV 2nd Refresh: 8 min
RHV Removal: Less than 1 minute