Bug 1981834

Summary: Enable pagination for list of RHV VMs
Product: Migration Toolkit for Virtualization Reporter: Jeff Ortel <jortel>
Component: InventoryAssignee: Jeff Ortel <jortel>
Status: CLOSED ERRATA QA Contact: mlehrer
Severity: medium Docs Contact: Avital Pinnick <apinnick>
Priority: medium    
Version: 2.1.0CC: fdupont, mlehrer
Target Milestone: ---   
Target Release: 2.1.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-08-26 07:09:25 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Jeff Ortel 2021-07-13 13:59:36 UTC
The RHV API cannot support listing all VMs at once when following sub-collections without significant impact to RHV. As a result, the inventory controller need to fetch VMs in pages.

Comment 2 Ilanit Stein 2021-08-08 13:03:47 UTC
@Jeff
Could you please provide verification steps?

Comment 3 Jeff Ortel 2021-08-09 12:50:55 UTC
VMs are loaded in pages of 500.
In the log you will see entries like this.
{"level":"info","ts":1628284414.6040213,"logger":"collector|ovirt","msg":"List VMs.","provider":"konveyor-forklift/rhv01","page":1}
{"level":"info","ts":1628284667.313123,"logger":"collector|ovirt","msg":"List VMs.","provider":"konveyor-forklift/rhv01","page":2}
{"level":"info","ts":1628284807.3989713,"logger":"collector|ovirt","msg":"List VMs.","provider":"konveyor-forklift/rhv01","page":3}

Comment 4 mlehrer 2021-08-16 12:15:32 UTC
Inventory Pod log:
{"level":"info","ts":1629115587.7876537,"logger":"collector|ovirt","msg":"List VMs.","provider":"openshift-mtv/rhv-red01-hasheni","page":3}
{"level":"info","ts":1629115656.2526665,"logger":"collector|ovirt","msg":"List VMs.","provider":"openshift-mtv/rhv-red01-hasheni","page":4}
{"level":"info","ts":1629115719.3605123,"logger":"collector|ovirt","msg":"List VMs.","provider":"openshift-mtv/rhv-red01-hasheni","page":5}

from: /var/log/httpd/ovirt-requests-log
[16/Aug/2021:08:05:04 -0400] 10.1.39.31 "Correlation-Id: b10336b7-60e6-443b-b4b9-84788b2b2289" "Duration: 65467526us" "GET /ovirt-engine/api/vms?follow=disk_attachments%2Chost_devices%2Csnapshots%2Cwatchdogs%2Ccdroms%2Cnics&max=500&search=page+2 HTTP/1.1" 238866

Moving to verified

Comment 7 errata-xmlrpc 2021-08-26 07:09:25 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Migration Toolkit for Virtualization 2.1.0), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2021:3278