Red Hat Satellite engineering is moving the tracking of its product development work on Satellite to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "Satellite project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs will be migrated starting at the end of May. If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "Satellite project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/SAT-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 1563284 - Remove use of hdparm for IO tests - misleading results
Summary: Remove use of hdparm for IO tests - misleading results
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Red Hat Satellite
Classification: Red Hat
Component: Satellite Maintain
Version: Unspecified
Hardware: Unspecified
OS: Unspecified
unspecified
medium
Target Milestone: Unspecified
Assignee: Kavita
QA Contact: Nikhil Kathole
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2018-04-03 14:17 UTC by Mike McCune
Modified: 2023-09-15 00:07 UTC (History)
7 users (show)

Fixed In Version: foreman_maintain-0.2.4
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2020-03-05 18:07:05 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Foreman Issue Tracker 23755 0 Normal Closed Remove use of hdparm for IO tests - misleading results 2020-03-31 13:40:22 UTC
Red Hat Bugzilla 1622616 0 medium CLOSED Inconsistency over fio utility benchmarking 2024-03-25 15:07:16 UTC

Internal Links: 1622616

Description Mike McCune 2018-04-03 14:17:22 UTC
Now that we are shipping fio, we should remove the use of hdparm in foreman-maintain's IO benchmark tests as it can often lead to high value tests that are often way lower when a proper test with fio is run.

EG, we have seen situations where hdparm indicates speeds of 400-500MB/sec but fio shows in the ~10MB/sec range in Satellites that were performing poorly.

Comment 2 Kavita 2018-05-31 08:31:11 UTC
Created redmine issue http://projects.theforeman.org/issues/23755 from this bug

Comment 3 Satellite Program 2018-06-07 14:00:43 UTC
Moving this bug to POST for triage into Satellite 6 since the upstream issue http://projects.theforeman.org/issues/23755 has been resolved.

Comment 5 Nikhil Kathole 2018-08-05 15:15:32 UTC
VERIFIED

Version tested:
# rpm -qa | grep maintain
rubygem-foreman_maintain-0.2.6-1.el7sat.noarch


Only fio package is installed by foreman-maintain. 

# foreman-maintain upgrade check --target-version 6.4.z
Running preparation steps required to run the next scenarios
================================================================================
Procedures::Packages::Install: 

==================================================================================================================================================
 Package       Arch             Version              Repository                                                                              Size
==================================================================================================================================================
Installing:
 fio           x86_64           3.1-2.el7            Sat6-CI_Satellite_Maintenance_Next_Composes_Satellite_Maintenance_Next_RHEL7           451 k

Transaction Summary
==================================================================================================================================================
Install  1 Package

Total download size: 451 k
Installed size: 1.7 M
Is this ok [y/d/N]:

Comment 7 Kavita 2019-02-18 13:38:15 UTC
@Mike,

After removal of hdparm, there are many cases opened by customers as disk speed check is failing.
BZ link - https://bugzilla.redhat.com/show_bug.cgi?id=1641784
There is difference between results by hdparm and by fio as you mentioned and BZ-1641784 description also shows the same.

Any pointers for us to debug further and fix the issue?

We thought to check disk-speed more than ones by some interval and by taking average but it might not work as there might be huge difference in results from two runs.
For satellite 6.3 & 6.4 version, mentioned expected speed is a range 60 - 80 Megabytes per second in the documentation. 
Do we need to modify threshold (currently its 60 as per documentation) against which foreman-maintain compares system's disk-speed?

Comment 8 Mike McCune 2020-03-05 18:07:05 UTC
we long stopped using hdparm and have other bugs open around our current fio benchmarking to track related issues.

Comment 9 Red Hat Bugzilla 2023-09-15 00:07:19 UTC
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 500 days


Note You need to log in before you can comment on or make changes to this bug.