Description of problem: MiqVimBrokerWorker exceeding memory after upgrading from 5.6 -> 5.7. To reduce memory usage retrieve host storage devices host by host instead of in one call. This was originally done to increase performance but the vast majority of the overhead was due to running garbage collection on every API call. Now that we don't do this the performance increase of retrieving all hosts in one call is greatly reduced. Want to revert these changes back so we don't consume as much memory. Version-Release number of selected component (if applicable): 5.7.0.1717
Created attachment 1277196 [details] 5.7.0.17 revert of https://github.com/ManageIQ/manageiq/pull/11629
New commit detected on ManageIQ/manageiq-providers-vmware/master: https://github.com/ManageIQ/manageiq-providers-vmware/commit/fa2049fb136b91b706fb3f887434003c1642d41d commit fa2049fb136b91b706fb3f887434003c1642d41d Author: Adam Grare <agrare> AuthorDate: Tue Mar 14 20:00:13 2017 -0400 Commit: Adam Grare <agrare> CommitDate: Mon May 8 19:13:38 2017 -0400 Retrieve host storage devices host-by-host To reduce memory usage retrieve host storage devices host by host instead of in one call. This was originally done to increase performance but the vast majority of the overhead was due to running garbage collection on every API call. Now that we don't do this the performance increase of retrieving all hosts in one call is greatly reduced. https://bugzilla.redhat.com/show_bug.cgi?id=1448963 .../providers/vmware/infra_manager/refresher.rb | 17 +- .../miq_vim_inventory/hostSystemsStorageDevice.yml | 6613 -------------------- .../vim_data/miq_vim_inventory/storageDevice.yml | 5799 +++++++++++++++++ 3 files changed, 5810 insertions(+), 6619 deletions(-) delete mode 100644 spec/tools/vim_data/miq_vim_inventory/hostSystemsStorageDevice.yml create mode 100644 spec/tools/vim_data/miq_vim_inventory/storageDevice.yml
Verified in 5.9.0.4