1640705 – foreman-maintain gives varying disk speed reports between versions

Red Hat Satellite engineering is moving the tracking of its product development work on Satellite to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "Satellite project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs will be migrated starting at the end of May. If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "Satellite project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/SAT-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.

Bug 1640705 - foreman-maintain gives varying disk speed reports between versions

Summary: foreman-maintain gives varying disk speed reports between versions

Keywords:
Status:	CLOSED DUPLICATE of bug 1641784
Alias:	None
Product:	Red Hat Satellite
Classification:	Red Hat
Component:	Satellite Maintain
Sub Component:
Version:	6.4
Hardware:	Unspecified
OS:	Unspecified
Priority:	unspecified
Severity:	unspecified
Target Milestone:	Unspecified
Assignee:	Kavita
QA Contact:	Katello QA List
Docs Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+	depends on / blocked

Reported:	2018-10-18 14:44 UTC by Ben
Modified:	2018-10-26 14:30 UTC (History)
CC List:	6 users (show)
Fixed In Version:
Doc Type:	If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:	2018-10-26 14:30:45 UTC
Target Upstream Version:
Embargoed:

Attachments	(Terms of Use)

Links
System	ID	Private	Priority	Status	Summary	Last Updated
Foreman Issue Tracker	24959	0	Normal	New	Inconsistency over fio utility benchmarking	2020-10-05 13:28:38 UTC

Description Ben 2018-10-18 14:44:28 UTC

Description of problem:

With rubygem-foreman_maintain-0.1.6-1.el7sat.noarch (note Disk speed):

[root@satellite1 ~]# foreman-maintain upgrade check --target-version 6.3.z
Running Checks before upgrading to Satellite 6.3.z
================================================================================
Check for paused tasks:                                               [OK]
--------------------------------------------------------------------------------
Check whether all services are running using hammer ping:             [OK]
--------------------------------------------------------------------------------
Check to validate candlepin database:                                 [OK]
--------------------------------------------------------------------------------
Check for running tasks:                                              [OK]
--------------------------------------------------------------------------------
Check for old tasks in paused/stopped state:                          [OK]
--------------------------------------------------------------------------------
Check for pending tasks which are safe to delete:                     [OK]
--------------------------------------------------------------------------------
Check for tasks in planning state:                                    [OK]
--------------------------------------------------------------------------------
Check for recommended disk speed of pulp, mongodb, pgsql dir.: 
| Finished                                                                      

Disk speed : 507 MB/sec                                               [OK]
--------------------------------------------------------------------------------
Validate availability of repositories: 
/ Validating availability of repositories for 6.3                     [OK]      
--------------------------------------------------------------------------------

[root@satellite1 ~]#

But then with rubygem-foreman_maintain-0.2.11-1.el7sat.noarch (note Disk speed again):

[root@satellite1 ~]# foreman-maintain upgrade check --target-version 6.3.z
Running Checks before upgrading to Satellite 6.3.z
================================================================================
Check for verifying syntax for ISP DHCP configurations:               [SKIPPED]
DHCP feature is not enabled
--------------------------------------------------------------------------------
Check whether all services are running:                               [OK]
--------------------------------------------------------------------------------
Check whether all services are running using hammer ping:             [OK]
--------------------------------------------------------------------------------
Check for paused tasks:                                               [OK]
--------------------------------------------------------------------------------
Check to validate candlepin database:                                 [OK]
--------------------------------------------------------------------------------
Check if EPEL repository enabled on system: 
/ Checking for presence of EPEL repository                            [OK]      
--------------------------------------------------------------------------------
Check for running tasks:                                              [OK]
--------------------------------------------------------------------------------
Check for old tasks in paused/stopped state:                          [OK]
--------------------------------------------------------------------------------
Check for pending tasks which are safe to delete:                     [OK]
--------------------------------------------------------------------------------
Check for tasks in planning state:                                    [OK]
--------------------------------------------------------------------------------
Check for recommended disk speed of pulp, mongodb, pgsql dir.: 
/ Finished                                                                      

Disk speed : 28 MB/sec                                                [FAIL]
Slow disk detected /var/lib/pulp mounted on /dev/mapper/rhel--2-var.
             Actual disk speed: 28 MB/sec
             Expected disk speed: 60 MB/sec.
--------------------------------------------------------------------------------
Check whether reports have correct associations:                      [OK]
--------------------------------------------------------------------------------
Validate availability of repositories: 
- Validating availability of repositories for 6.3                     [OK]      
--------------------------------------------------------------------------------
Scenario [Checks before upgrading to Satellite 6.3.z] failed.

The following steps ended up in failing state:

  [disk-performance]

Resolve the failed steps and rerun
the command. In case the failures are false positives,
use --whitelist="disk-performance"


[root@satellite1 ~]#

This is on the same server, within about three minutes of each other.  The server is a VMWare guest on a Dell Compellent SAN, probably on the front line SSDs, but I can't be certain.


Version-Release number of selected component (if applicable):

RHEL7 fully patched as of 2018-10-18
Satellite 6.3.4, but with 
rubygem-foreman_maintain-0.2.11-1.el7sat.noarch
and a downgrade back to
rubygem-foreman_maintain-0.1.6-1.el7sat.noarch
to double-check what was going on


How reproducible:

Every time foreman-maintain is run


Steps to Reproduce:

1. Upgrade from rubygem-foreman_maintain-0.1.6-1.el7sat.noarch to rubygem-foreman_maintain-0.2.11-1.el7sat.noarch
2. Run "foreman-maintain upgrade check --target-version 6.3.z"
3. Observe "Disk speed" check


Actual results:

Wildly varying differences (order of magnitude) in measured/reported disk speed


Expected results:

Both versions of foreman-maintain to give vaguely similar results


Additional info:

I've tried running the newer version of foreman-maintain at various times throughout the day in case the SAN that backends this VM was busier at some times than others.  There wasn't a variation of more than 2-3MB/sec for any run.

Comment 1 Satellite Program 2018-10-18 16:01:01 UTC

Upstream bug assigned to kgaikwad

Comment 2 Brad Buckingham 2018-10-26 14:30:45 UTC

Ben,

Thanks for opening this bugzilla.  It appears to be related a change introduced and mentioned in https://bugzilla.redhat.com/show_bug.cgi?id=1641784#c1.  For now, I am going to close this one as a duplicate; however, please re-open if there are concerns.

*** This bug has been marked as a duplicate of bug 1641784 ***

Note You need to log in before you can comment on or make changes to this bug.