Bug 1655628 - Registered hosts' report performs poorly
Summary: Registered hosts' report performs poorly
Alias: None
Product: Red Hat Satellite
Classification: Red Hat
Component: Reporting
Version: 6.5.0
Hardware: Unspecified
OS: Unspecified
medium vote
Target Milestone: 6.5.0
Assignee: Marek Hulan
QA Contact: Lukáš Hellebrandt
Depends On: 1673898
TreeView+ depends on / blocked
Reported: 2018-12-03 15:27 UTC by Lukáš Hellebrandt
Modified: 2019-11-05 22:40 UTC (History)
5 users (show)

Fixed In Version: foreman-
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Last Closed: 2019-05-14 12:39:22 UTC
Target Upstream Version:

Attachments (Terms of Use)

System ID Private Priority Status Summary Last Updated
Foreman Issue Tracker 25624 0 Normal Closed Registered hosts' report performs poorly 2019-12-13 04:11:50 UTC
Red Hat Product Errata RHSA-2019:1222 0 None None None 2019-05-14 12:39:29 UTC

Description Lukáš Hellebrandt 2018-12-03 15:27:40 UTC
Description of problem:
Performance testing shows that there's most likely something done inefficiently in the Registered hosts report. I've tested on a Satellite with 10 000 systems. 

When running a report without filters, it takes 8 minutes (there are no performance requirements specified so this should be fine). However, when running with a host filter such that it limits hosts to only 500 of these 10 000, the report generation consistently fails with ISE after 30 minutes.

Tested on a RHEL7 machine with Intel Xeon, 4 sockets, 32 cores, hyperthreading, 2.7 Ghz, 128 GB RAM

Version-Release number of selected component (if applicable):
6.5 snap 5

How reproducible:
Deterministic on one machine but may be influenced by the machine's performance.

Steps to Reproduce:
1. Have a Satellite with 10 000 systems, 500 of them with some easily filterable name
2. Monitor -> Report Templates -> Registered Hosts -> Generate
3. Fill in a filter such that it selects 500 systems
4. Submit

Actual results:
ISE after 30 minutes

Expected results:
Report generated. I'd expect it to be faster than without the filter

Comment 3 Marek Hulan 2018-12-04 17:36:52 UTC
Created redmine issue https://projects.theforeman.org/issues/25624 from this bug

Comment 4 Bryan Kearney 2019-01-07 21:14:52 UTC
Moving this bug to POST for triage into Satellite 6 since the upstream issue https://projects.theforeman.org/issues/25624 has been resolved.

Comment 8 Lukáš Hellebrandt 2019-02-08 12:16:33 UTC
Verification blocked by bug 1673898.

Comment 9 Lukáš Hellebrandt 2019-03-28 12:37:06 UTC
Verified with Sat 6.5 snap 21.

Generating a report is now ~ 8 times faster (1 minute for 10000 systems). Also, filtering all hosts H to only hosts h is now faster than not filtering at all for |h|<<|H| (10 seconds for 700 systems).
The performance is, however, still a limit: with filter in form "<name>", for |h|=|H|=10000, the generating takes half an hour.

Comment 11 errata-xmlrpc 2019-05-14 12:39:22 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.


Note You need to log in before you can comment on or make changes to this bug.