Bug 2166865

Summary: metalsmith list taking more than ~150s at scale
Product: Red Hat OpenStack Reporter: Asma Syed Hameed <asyedham>
Component: python-metalsmithAssignee: Harald Jensås <hjensas>
Status: CLOSED ERRATA QA Contact: James E. LaBarre <jlabarre>
Severity: medium Docs Contact:
Priority: high    
Version: 17.1 (Wallaby)CC: eshames, hjensas, jkreger, pweeks, sbaker
Target Milestone: gaKeywords: Performance, Reopened, Scale, Triaged
Target Release: 17.1   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: python-metalsmith-1.4.4-1.20230515184003.5e7461e.el8ost Doc Type: No Doc Update
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2023-08-16 01:13:41 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Asma Syed Hameed 2023-02-03 09:37:55 UTC
Description of problem:

We have 3 controllers, 224 computes and 5 ceph storage nodes, the metalsmith list is taking ~150 seconds to list the overcloud nodes which is quite slower

Version-Release number of selected component (if applicable):
RHOS-17.1-RHEL-9-20221130.n.1

How reproducible:
100%

Steps to Reproduce:
1. deploy OSP 17.1 with ~250 nodes
2. run metalsmith list

Actual results:
taking  ~150 second

Expected results:
Improve the response time for metalsmith list

Comment 14 James E. LaBarre 2023-07-18 17:05:02 UTC
I can verify some of the changes are in the RHOS-17.1-RHEL-9-20230712.n.1 compose, but not the metalsmith/test/* files.  Were packages brought in from elsewhere for this test?

Comment 15 Julia Kreger 2023-07-18 17:16:28 UTC
Tests may be excluded from packaging, since realistically they are not something an end user can execute. The test, itself, would have just been a execution of the command, not specific tests.

Comment 16 James E. LaBarre 2023-07-18 19:51:42 UTC
Verified by Scale/Performance. 

Part of this has merged already, the remainder will be in z1

Comment 23 errata-xmlrpc 2023-08-16 01:13:41 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Release of components for Red Hat OpenStack Platform 17.1 (Wallaby)), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2023:4577