Bug 1245687 - [RFE] SCVMM post provisioning ems refresh takes too long
Summary: [RFE] SCVMM post provisioning ems refresh takes too long
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat CloudForms Management Engine
Classification: Red Hat
Component: Providers
Version: 5.4.0
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: GA
: 5.4.2
Assignee: Daniel Berger
QA Contact: Aziza Karol
URL:
Whiteboard:
: 1245680 (view as bug list)
Depends On: 1235384
Blocks:
TreeView+ depends on / blocked
 
Reported: 2015-07-22 14:19 UTC by Chris Pelland
Modified: 2019-11-14 06:49 UTC (History)
11 users (show)

Fixed In Version: 5.4.2.0
Doc Type: Enhancement
Doc Text:
Clone Of: 1235384
Environment:
Last Closed: 2015-09-09 12:25:46 UTC
Category: ---
Cloudforms Team: ---
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2015:1744 0 normal SHIPPED_LIVE CFME 5.4.2 bug fixes, and enhancement update 2015-09-09 16:25:05 UTC

Comment 1 Greg Blomquist 2015-07-28 19:15:18 UTC
*** Bug 1245680 has been marked as a duplicate of this bug. ***

Comment 2 Daniel Berger 2015-08-07 13:46:21 UTC
https://github.com/ManageIQ/manageiq/pull/3737

Comment 3 Daniel Berger 2015-08-11 18:55:27 UTC
I closed the previous PR, and replaced it with this one: https://github.com/ManageIQ/manageiq/pull/3786

That was merged.

Comment 4 Greg Blomquist 2015-08-16 21:41:47 UTC
I don't see a downstream commit for this yet on gitlab ... putting this back to on_dev until this gets backported to 5.4.z branch.

Comment 5 Greg Blomquist 2015-08-16 21:45:20 UTC
Also, I'd like to see https://github.com/ManageIQ/manageiq/pull/3694 backported  for this in addition to https://github.com/ManageIQ/manageiq/pull/3786 mentioned in comment #3.

Comment 7 CFME Bot 2015-08-18 22:07:36 UTC
New commit detected on cfme/5.4.z:
https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=84a40b4ec5166648abe6656a125e93c70ab4029f

commit 84a40b4ec5166648abe6656a125e93c70ab4029f
Author:     Daniel Berger <dberger>
AuthorDate: Wed Jul 29 14:18:24 2015 -0600
Commit:     Daniel Berger <dberger>
CommitDate: Tue Aug 18 11:21:55 2015 -0600

    Remove XML temp file generation and just send results to stdout.
    
    https://github.com/ManageIQ/manageiq/pull/3653
    
    https://bugzilla.redhat.com/show_bug.cgi?id=1245687

 vmdb/app/models/ems_refresh/parsers/ps_scripts/get_inventory.ps1 | 5 +----
 1 file changed, 1 insertion(+), 4 deletions(-)

Comment 8 CFME Bot 2015-08-18 22:07:40 UTC
New commit detected on cfme/5.4.z:
https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=54c952b1d5ba7844216ad894d82ec2ab5e886edf

commit 54c952b1d5ba7844216ad894d82ec2ab5e886edf
Author:     Daniel Berger <dberger>
AuthorDate: Mon Aug 3 09:22:11 2015 -0600
Commit:     Daniel Berger <dberger>
CommitDate: Tue Aug 18 11:21:55 2015 -0600

    Revert back to Export-Clixml because of expected output format, but this time use the -ReadCount option to speed it up.
    
    https://bugzilla.redhat.com/show_bug.cgi?id=1245687

 vmdb/app/models/ems_refresh/parsers/ps_scripts/get_inventory.ps1 | 5 ++++-
 1 file changed, 4 insertions(+), 1 deletion(-)

Comment 9 CFME Bot 2015-08-18 22:07:44 UTC
New commit detected on cfme/5.4.z:
https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=04a8584bd826c57dd93e6b9cd9bbceb30c3fca74

commit 04a8584bd826c57dd93e6b9cd9bbceb30c3fca74
Author:     Daniel Berger <dberger>
AuthorDate: Mon Aug 17 10:48:05 2015 -0600
Commit:     Daniel Berger <dberger>
CommitDate: Tue Aug 18 11:21:55 2015 -0600

    Use nokogiri instead of rexml.
    
    Use nokogiri to collect inventory for scvmm.
    
    https://bugzilla.redhat.com/show_bug.cgi?id=1245687

 lib/test/xml/tc_nokogiri.rb      |   2 +-
 lib/util/miq-xml.rb              | 132 +++++++++++++++++++--------------------
 lib/util/win32/miq-powershell.rb |  32 +++++++---
 lib/util/xml/miq_nokogiri.rb     |  13 +++-
 4 files changed, 101 insertions(+), 78 deletions(-)

Comment 10 CFME Bot 2015-08-18 22:09:00 UTC
New commit detected on cfme/5.4.z:
https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=3e631851d53006304ffbd9fc50f34cf1904de47e

commit 3e631851d53006304ffbd9fc50f34cf1904de47e
Merge: 0fe7d4a 04a8584
Author:     Greg Blomquist <gblomqui>
AuthorDate: Tue Aug 18 14:56:28 2015 -0400
Commit:     Greg Blomquist <gblomqui>
CommitDate: Tue Aug 18 14:56:28 2015 -0400

    Merge branch 'powershell_updates' into '5.4.z'
    
    Powershell and SCVMM inventory collection updates
    
    Use nokogiri instead of rexml for scvmm inventory collection.
    
    Use -readcount option to speed up reading of xml on powershell side.
    
    * https://github.com/ManageIQ/manageiq/pull/3786
    * https://github.com/ManageIQ/manageiq/pull/3653
    * https://github.com/ManageIQ/manageiq/pull/3694
    
    PR 3653 and PR 3694 merged cleanly. PR 3786 required the use of the following command:
    
    `git apply -p3 --directory=lib --whitespace=fix -v 0001-Updated-powershell-inventory-collection-to-use-Nokog.patch`
    
    https://bugzilla.redhat.com/show_bug.cgi?id=1245687
    
    See merge request !226

 lib/test/xml/tc_nokogiri.rb                        |   2 +-
 lib/util/miq-xml.rb                                | 132 ++++++++++-----------
 lib/util/win32/miq-powershell.rb                   |  32 +++--
 lib/util/xml/miq_nokogiri.rb                       |  13 +-
 .../parsers/ps_scripts/get_inventory.ps1           |   6 +-
 5 files changed, 104 insertions(+), 81 deletions(-)

Comment 11 CFME Bot 2015-08-18 22:09:03 UTC
New commit detected on cfme/5.4.z:
https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=54c952b1d5ba7844216ad894d82ec2ab5e886edf

commit 54c952b1d5ba7844216ad894d82ec2ab5e886edf
Author:     Daniel Berger <dberger>
AuthorDate: Mon Aug 3 09:22:11 2015 -0600
Commit:     Daniel Berger <dberger>
CommitDate: Tue Aug 18 11:21:55 2015 -0600

    Revert back to Export-Clixml because of expected output format, but this time use the -ReadCount option to speed it up.
    
    https://bugzilla.redhat.com/show_bug.cgi?id=1245687

 vmdb/app/models/ems_refresh/parsers/ps_scripts/get_inventory.ps1 | 5 ++++-
 1 file changed, 4 insertions(+), 1 deletion(-)

Comment 12 CFME Bot 2015-08-18 22:09:06 UTC
New commit detected on cfme/5.4.z:
https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=04a8584bd826c57dd93e6b9cd9bbceb30c3fca74

commit 04a8584bd826c57dd93e6b9cd9bbceb30c3fca74
Author:     Daniel Berger <dberger>
AuthorDate: Mon Aug 17 10:48:05 2015 -0600
Commit:     Daniel Berger <dberger>
CommitDate: Tue Aug 18 11:21:55 2015 -0600

    Use nokogiri instead of rexml.
    
    Use nokogiri to collect inventory for scvmm.
    
    https://bugzilla.redhat.com/show_bug.cgi?id=1245687

 lib/test/xml/tc_nokogiri.rb      |   2 +-
 lib/util/miq-xml.rb              | 132 +++++++++++++++++++--------------------
 lib/util/win32/miq-powershell.rb |  32 +++++++---
 lib/util/xml/miq_nokogiri.rb     |  13 +++-
 4 files changed, 101 insertions(+), 78 deletions(-)

Comment 13 CFME Bot 2015-08-18 22:09:45 UTC
New commit detected on cfme/5.4.z:
https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=3e631851d53006304ffbd9fc50f34cf1904de47e

commit 3e631851d53006304ffbd9fc50f34cf1904de47e
Merge: 0fe7d4a 04a8584
Author:     Greg Blomquist <gblomqui>
AuthorDate: Tue Aug 18 14:56:28 2015 -0400
Commit:     Greg Blomquist <gblomqui>
CommitDate: Tue Aug 18 14:56:28 2015 -0400

    Merge branch 'powershell_updates' into '5.4.z'
    
    Powershell and SCVMM inventory collection updates
    
    Use nokogiri instead of rexml for scvmm inventory collection.
    
    Use -readcount option to speed up reading of xml on powershell side.
    
    * https://github.com/ManageIQ/manageiq/pull/3786
    * https://github.com/ManageIQ/manageiq/pull/3653
    * https://github.com/ManageIQ/manageiq/pull/3694
    
    PR 3653 and PR 3694 merged cleanly. PR 3786 required the use of the following command:
    
    `git apply -p3 --directory=lib --whitespace=fix -v 0001-Updated-powershell-inventory-collection-to-use-Nokog.patch`
    
    https://bugzilla.redhat.com/show_bug.cgi?id=1245687
    
    See merge request !226

 lib/test/xml/tc_nokogiri.rb                        |   2 +-
 lib/util/miq-xml.rb                                | 132 ++++++++++-----------
 lib/util/win32/miq-powershell.rb                   |  32 +++--
 lib/util/xml/miq_nokogiri.rb                       |  13 +-
 .../parsers/ps_scripts/get_inventory.ps1           |   6 +-
 5 files changed, 104 insertions(+), 81 deletions(-)

Comment 14 CFME Bot 2015-08-18 22:09:48 UTC
New commit detected on cfme/5.4.z:
https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=84a40b4ec5166648abe6656a125e93c70ab4029f

commit 84a40b4ec5166648abe6656a125e93c70ab4029f
Author:     Daniel Berger <dberger>
AuthorDate: Wed Jul 29 14:18:24 2015 -0600
Commit:     Daniel Berger <dberger>
CommitDate: Tue Aug 18 11:21:55 2015 -0600

    Remove XML temp file generation and just send results to stdout.
    
    https://github.com/ManageIQ/manageiq/pull/3653
    
    https://bugzilla.redhat.com/show_bug.cgi?id=1245687

 vmdb/app/models/ems_refresh/parsers/ps_scripts/get_inventory.ps1 | 5 +----
 1 file changed, 1 insertion(+), 4 deletions(-)

Comment 15 CFME Bot 2015-08-18 22:10:25 UTC
New commit detected on cfme/5.4.z:
https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=84a40b4ec5166648abe6656a125e93c70ab4029f

commit 84a40b4ec5166648abe6656a125e93c70ab4029f
Author:     Daniel Berger <dberger>
AuthorDate: Wed Jul 29 14:18:24 2015 -0600
Commit:     Daniel Berger <dberger>
CommitDate: Tue Aug 18 11:21:55 2015 -0600

    Remove XML temp file generation and just send results to stdout.
    
    https://github.com/ManageIQ/manageiq/pull/3653
    
    https://bugzilla.redhat.com/show_bug.cgi?id=1245687

 vmdb/app/models/ems_refresh/parsers/ps_scripts/get_inventory.ps1 | 5 +----
 1 file changed, 1 insertion(+), 4 deletions(-)

Comment 16 CFME Bot 2015-08-18 22:11:06 UTC
New commit detected on cfme/5.4.z:
https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=3e631851d53006304ffbd9fc50f34cf1904de47e

commit 3e631851d53006304ffbd9fc50f34cf1904de47e
Merge: 0fe7d4a 04a8584
Author:     Greg Blomquist <gblomqui>
AuthorDate: Tue Aug 18 14:56:28 2015 -0400
Commit:     Greg Blomquist <gblomqui>
CommitDate: Tue Aug 18 14:56:28 2015 -0400

    Merge branch 'powershell_updates' into '5.4.z'
    
    Powershell and SCVMM inventory collection updates
    
    Use nokogiri instead of rexml for scvmm inventory collection.
    
    Use -readcount option to speed up reading of xml on powershell side.
    
    * https://github.com/ManageIQ/manageiq/pull/3786
    * https://github.com/ManageIQ/manageiq/pull/3653
    * https://github.com/ManageIQ/manageiq/pull/3694
    
    PR 3653 and PR 3694 merged cleanly. PR 3786 required the use of the following command:
    
    `git apply -p3 --directory=lib --whitespace=fix -v 0001-Updated-powershell-inventory-collection-to-use-Nokog.patch`
    
    https://bugzilla.redhat.com/show_bug.cgi?id=1245687
    
    See merge request !226

 lib/test/xml/tc_nokogiri.rb                        |   2 +-
 lib/util/miq-xml.rb                                | 132 ++++++++++-----------
 lib/util/win32/miq-powershell.rb                   |  32 +++--
 lib/util/xml/miq_nokogiri.rb                       |  13 +-
 .../parsers/ps_scripts/get_inventory.ps1           |   6 +-
 5 files changed, 104 insertions(+), 81 deletions(-)

Comment 17 CFME Bot 2015-08-18 22:11:22 UTC
New commit detected on cfme/5.4.z:
https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=04a8584bd826c57dd93e6b9cd9bbceb30c3fca74

commit 04a8584bd826c57dd93e6b9cd9bbceb30c3fca74
Author:     Daniel Berger <dberger>
AuthorDate: Mon Aug 17 10:48:05 2015 -0600
Commit:     Daniel Berger <dberger>
CommitDate: Tue Aug 18 11:21:55 2015 -0600

    Use nokogiri instead of rexml.
    
    Use nokogiri to collect inventory for scvmm.
    
    https://bugzilla.redhat.com/show_bug.cgi?id=1245687

 lib/test/xml/tc_nokogiri.rb      |   2 +-
 lib/util/miq-xml.rb              | 132 +++++++++++++++++++--------------------
 lib/util/win32/miq-powershell.rb |  32 +++++++---
 lib/util/xml/miq_nokogiri.rb     |  13 +++-
 4 files changed, 101 insertions(+), 78 deletions(-)

Comment 18 CFME Bot 2015-08-18 22:11:25 UTC
New commit detected on cfme/5.4.z:
https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=54c952b1d5ba7844216ad894d82ec2ab5e886edf

commit 54c952b1d5ba7844216ad894d82ec2ab5e886edf
Author:     Daniel Berger <dberger>
AuthorDate: Mon Aug 3 09:22:11 2015 -0600
Commit:     Daniel Berger <dberger>
CommitDate: Tue Aug 18 11:21:55 2015 -0600

    Revert back to Export-Clixml because of expected output format, but this time use the -ReadCount option to speed it up.
    
    https://bugzilla.redhat.com/show_bug.cgi?id=1245687

 vmdb/app/models/ems_refresh/parsers/ps_scripts/get_inventory.ps1 | 5 ++++-
 1 file changed, 4 insertions(+), 1 deletion(-)

Comment 20 Aziza Karol 2015-09-01 05:28:47 UTC
This issue requires verification on SCVMM provider with 800+ VMs and QE does not have the environment to test this, so verified the commits.

Good to go in 5.4.2

Comment 22 errata-xmlrpc 2015-09-09 12:25:46 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHBA-2015-1744.html


Note You need to log in before you can comment on or make changes to this bug.