Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.
RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.

Bug 2166780

Summary: [RHEL 9.2] ucx: rebase to current upstream
Product: Red Hat Enterprise Linux 9 Reporter: Michal Schmidt <mschmidt>
Component: ucxAssignee: Michal Schmidt <mschmidt>
Status: CLOSED ERRATA QA Contact: Afom T. Michael <tmichael>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 9.2CC: rdma-dev-team, tmichael
Target Milestone: rcKeywords: Rebase, Triaged
Target Release: ---Flags: pm-rhel: mirror+
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: ucx-1.13.1-2.el9 Doc Type: Rebase: Bug Fixes and Enhancements
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2023-05-09 07:53:35 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Michal Schmidt 2023-02-02 22:24:02 UTC 
Description of problem:
RHEL 9.2 could use a rebase of the ucx package to the latest bugfix release.
Current version of ucx in upstream and Fedora is 1.13.1.

Version-Release number of selected component (if applicable):
ucx-1.13.0-1.el9
Comment 1 Michal Schmidt 2023-02-03 15:42:09 UTC 
ucx-1.13.1-2.el9:
https://brewweb.engineering.redhat.com/brew/buildinfo?buildID=2358056
Comment 2 Afom T. Michael 2023-02-04 07:37:59 UTC 
Marking "Verified: Tested" as ucx test with ucx-1.13.1-2.el9.x86_64 passed. Below is a sample of test result.

[root@rdma-dev-22 ucx]$ uname -r
5.14.0-249.el9.x86_64
[root@rdma-dev-22 ucx]$ rpm -q ucx rdma-core
ucx-1.13.1-2.el9.x86_64
rdma-core-44.0-2.el9.x86_64
[root@rdma-dev-22 ucx]$ ibstatus 
Infiniband device 'mlx5_0' port 1 status:
	default gid:	 fe80:0000:0000:0000:268a:07ff:fe56:b834
	base lid:	 0x0
	sm lid:		 0x0
	state:		 4: ACTIVE
	phys state:	 5: LinkUp
	rate:		 100 Gb/sec (4X EDR)
	link_layer:	 Ethernet

Infiniband device 'mlx5_1' port 1 status:
	default gid:	 fe80:0000:0000:0000:248a:0703:0049:d75c
	base lid:	 0x13
	sm lid:		 0x3
	state:		 4: ACTIVE
	phys state:	 5: LinkUp
	rate:		 56 Gb/sec (4X FDR)
	link_layer:	 InfiniBand

Infiniband device 'mlx5_2' port 1 status:
	default gid:	 fe80:0000:0000:0001:248a:0703:0049:d75d
	base lid:	 0x2c
	sm lid:		 0x1
	state:		 4: ACTIVE
	phys state:	 5: LinkUp
	rate:		 100 Gb/sec (4X EDR)
	link_layer:	 InfiniBand

[root@rdma-dev-22 ucx]$ lspci | grep Mellanox
04:00.0 Ethernet controller: Mellanox Technologies MT27700 Family [ConnectX-4]
82:00.0 Infiniband controller: Mellanox Technologies MT27700 Family [ConnectX-4]
82:00.1 Infiniband controller: Mellanox Technologies MT27700 Family [ConnectX-4]
[root@rdma-dev-22 ucx]$ 

ucx/ucx/ test results on rdma-dev-21/rdma-dev-22 & Beaker job J:7497917:
5.14.0-249.el9.x86_64, rdma-core-44.0-2.el9, mlx5, roce, ConnectX-4 & mlx5_0
    Result | Status | Test
  ---------+--------+------------------------------------
      PASS |      0 | install ucx
      PASS |      0 | install ucx-cma ucx-ib ucx-rdmacm
      PASS |      0 | ucx version info
      PASS |      0 | ucx build info
      PASS |      0 | ucx system info
      PASS |      0 | ucx device info
      PASS |      0 | ucx transport info - cma
      PASS |      0 | ucx transport info - dc_mlx5
      PASS |      0 | ucx transport info - posix
      PASS |      0 | ucx transport info - rc_mlx5
      PASS |      0 | ucx transport info - rc_verbs
      PASS |      0 | ucx transport info - self
      PASS |      0 | ucx transport info - sysv
      PASS |      0 | ucx transport info - tcp
      PASS |      0 | ucx transport info - ud_mlx5
      PASS |      0 | ucx transport info - ud_verbs
      PASS |      0 | ucx configuration info
      PASS |      0 | ucp context info for a
      PASS |      0 | ucp worker info for a
      PASS |      0 | ucp endpoint config for a
      PASS |      0 | ucp context info for r
      PASS |      0 | ucp worker info for r
      PASS |      0 | ucp endpoint config for r
      PASS |      0 | ucp context info for t
      PASS |      0 | ucp worker info for t
      PASS |      0 | ucp endpoint config for t
      PASS |      0 | ucp context info for m
      PASS |      0 | ucp worker info for m
      PASS |      0 | ucp endpoint config for m
      PASS |      0 | ucp context info for ae
      PASS |      0 | ucp worker info for ae
      PASS |      0 | ucp endpoint config for ae
      PASS |      0 | ucp context info for re
      PASS |      0 | ucp worker info for re
      PASS |      0 | ucp endpoint config for re
      PASS |      0 | ucp context info for te
      PASS |      0 | ucp worker info for te
      PASS |      0 | ucp endpoint config for te
      PASS |      0 | ucp context info for me
      PASS |      0 | ucp worker info for me
      PASS |      0 | ucp endpoint config for me
      PASS |      0 | ucp context info for aw
      PASS |      0 | ucp worker info for aw
      PASS |      0 | ucp endpoint config for aw
      PASS |      0 | ucp context info for rw
      PASS |      0 | ucp worker info for rw
      PASS |      0 | ucp endpoint config for rw
      PASS |      0 | ucp context info for tw
      PASS |      0 | ucp worker info for tw
      PASS |      0 | ucp endpoint config for tw
      PASS |      0 | ucp context info for mw
      PASS |      0 | ucp worker info for mw
      PASS |      0 | ucp endpoint config for mw
      PASS |      0 | ucx type and struct info
      PASS |      0 | ucx_perftest am_lat
      PASS |      0 | ucx_perftest am_bw
      PASS |      0 | ucx_perftest tag_lat
      PASS |      0 | ucx_perftest tag_bw
      PASS |      0 | ucx_perftest ucp_put_lat
      PASS |      0 | ucx_perftest ucp_put_bw
      PASS |      0 | ucx_perftest ucp_get
      PASS |      0 | openmpi setup
      PASS |      0 | openmpi built with ucx
Checking for failures and known issues:
  no test failures
Comment 5 Afom T. Michael 2023-02-07 06:59:47 UTC 
Moving to Verified as tests with ucx-1.13.1-2.el9.x86_64 passed. Below is info & sample of test result.

DISTRO=RHEL-9.2.0-20230205.12
+ [23-02-06 16:06:38] cat /etc/redhat-release
Red Hat Enterprise Linux release 9.2 Beta (Plow)
[...snip...]
+ [23-02-06 16:06:38] rpm -q rdma-core linux-firmware
rdma-core-44.0-2.el9.x86_64
linux-firmware-20221214-129.el9.noarch
+ [23-02-06 16:06:38] tail /sys/class/infiniband/mlx5_0/fw_ver /sys/class/infiniband/mlx5_1/fw_ver
==> /sys/class/infiniband/mlx5_0/fw_ver <==
20.32.2004

==> /sys/class/infiniband/mlx5_1/fw_ver <==
20.32.2004
+ [23-02-06 16:06:38] lspci
+ [23-02-06 16:06:38] grep -i -e ethernet -e infiniband -e omni -e ConnectX
41:00.0 Infiniband controller: Mellanox Technologies MT28908 Family [ConnectX-6]
c1:00.0 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5720 Gigabit Ethernet PCIe
c1:00.1 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5720 Gigabit Ethernet PCIe
c4:00.0 Ethernet controller: Mellanox Technologies MT28908 Family [ConnectX-6]
[...snip...]
+ [23-02-06 16:06:38] ibstatus
Infiniband device 'mlx5_0' port 1 status:
	default gid:	 fe80:0000:0000:0000:b8ce:f603:0079:d00e
	base lid:	 0x2c
	sm lid:		 0x3
	state:		 4: ACTIVE
	phys state:	 5: LinkUp
	rate:		 100 Gb/sec (4X EDR)
	link_layer:	 InfiniBand

Infiniband device 'mlx5_1' port 1 status:
	default gid:	 fe80:0000:0000:0000:bace:f6ff:fe79:cfce
	base lid:	 0x0
	sm lid:		 0x0
	state:		 4: ACTIVE
	phys state:	 5: LinkUp
	rate:		 100 Gb/sec (4X EDR)
	link_layer:	 Ethernet
[...snip...]
+ [23-02-06 16:06:39] dnf install -y --setopt=strict=0 --nogpgcheck ucx
[...snip...]
Package ucx-1.13.1-2.el9.x86_64 is already installed.
Dependencies resolved.
Nothing to do.
[...snip...]
+ [23-02-06 16:06:40] dnf install -y --setopt=strict=0 --nogpgcheck ucx-cma ucx-ib ucx-rdmacm
[...snip...]
================================================================================
 Package          Architecture Version             Repository              Size
================================================================================
Installing:
 ucx-cma          x86_64       1.13.1-2.el9        beaker-AppStream        18 k
 ucx-ib           x86_64       1.13.1-2.el9        beaker-AppStream       204 k
 ucx-rdmacm       x86_64       1.13.1-2.el9        beaker-AppStream        30 k

Transaction Summary
================================================================================
Install  3 Packages

Total download size: 252 k
Installed size: 597 k
Downloading Packages:
(1/3): ucx-rdmacm-1.13.1-2.el9.x86_64.rpm       9.5 MB/s |  30 kB     00:00    
(2/3): ucx-cma-1.13.1-2.el9.x86_64.rpm          4.9 MB/s |  18 kB     00:00    
(3/3): ucx-ib-1.13.1-2.el9.x86_64.rpm            35 MB/s | 204 kB     00:00    
--------------------------------------------------------------------------------
Total                                            25 MB/s | 252 kB     00:00     
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                        1/1 
  Installing       : ucx-ib-1.13.1-2.el9.x86_64                             1/3 
  Installing       : ucx-rdmacm-1.13.1-2.el9.x86_64                         2/3 
  Installing       : ucx-cma-1.13.1-2.el9.x86_64                            3/3 
  Running scriptlet: ucx-cma-1.13.1-2.el9.x86_64                            3/3 
  Verifying        : ucx-cma-1.13.1-2.el9.x86_64                            1/3 
  Verifying        : ucx-ib-1.13.1-2.el9.x86_64                             2/3 
  Verifying        : ucx-rdmacm-1.13.1-2.el9.x86_64                         3/3 
Installed products updated.

Installed:
  ucx-cma-1.13.1-2.el9.x86_64              ucx-ib-1.13.1-2.el9.x86_64          
  ucx-rdmacm-1.13.1-2.el9.x86_64          


ucx/ucx/ test results on rdma-qe-42/rdma-qe-43 & Beaker job J:7505254:
5.14.0-252.el9.x86_64, rdma-core-44.0-2.el9, mlx5, roce.45, ConnectX-6 & mlx5_1
    Result | Status | Test
  ---------+--------+------------------------------------
      PASS |      0 | install ucx
      PASS |      0 | install ucx-cma ucx-ib ucx-rdmacm
      PASS |      0 | ucx version info
      PASS |      0 | ucx build info
      PASS |      0 | ucx system info
      PASS |      0 | ucx device info
      PASS |      0 | ucx transport info - cma
      PASS |      0 | ucx transport info - dc_mlx5
      PASS |      0 | ucx transport info - posix
      PASS |      0 | ucx transport info - rc_mlx5
      PASS |      0 | ucx transport info - rc_verbs
      PASS |      0 | ucx transport info - self
      PASS |      0 | ucx transport info - sysv
      PASS |      0 | ucx transport info - tcp
      PASS |      0 | ucx transport info - ud_mlx5
      PASS |      0 | ucx transport info - ud_verbs
      PASS |      0 | ucx configuration info
      PASS |      0 | ucp context info for a
      PASS |      0 | ucp worker info for a
      PASS |      0 | ucp endpoint config for a
      PASS |      0 | ucp context info for r
      PASS |      0 | ucp worker info for r
      PASS |      0 | ucp endpoint config for r
      PASS |      0 | ucp context info for t
      PASS |      0 | ucp worker info for t
      PASS |      0 | ucp endpoint config for t
      PASS |      0 | ucp context info for m
      PASS |      0 | ucp worker info for m
      PASS |      0 | ucp endpoint config for m
      PASS |      0 | ucp context info for ae
      PASS |      0 | ucp worker info for ae
      PASS |      0 | ucp endpoint config for ae
      PASS |      0 | ucp context info for re
      PASS |      0 | ucp worker info for re
      PASS |      0 | ucp endpoint config for re
      PASS |      0 | ucp context info for te
      PASS |      0 | ucp worker info for te
      PASS |      0 | ucp endpoint config for te
      PASS |      0 | ucp context info for me
      PASS |      0 | ucp worker info for me
      PASS |      0 | ucp endpoint config for me
      PASS |      0 | ucp context info for aw
      PASS |      0 | ucp worker info for aw
      PASS |      0 | ucp endpoint config for aw
      PASS |      0 | ucp context info for rw
      PASS |      0 | ucp worker info for rw
      PASS |      0 | ucp endpoint config for rw
      PASS |      0 | ucp context info for tw
      PASS |      0 | ucp worker info for tw
      PASS |      0 | ucp endpoint config for tw
      PASS |      0 | ucp context info for mw
      PASS |      0 | ucp worker info for mw
      PASS |      0 | ucp endpoint config for mw
      PASS |      0 | ucx type and struct info
      PASS |      0 | ucx_perftest am_lat
      PASS |      0 | ucx_perftest am_bw
      PASS |      0 | ucx_perftest tag_lat
      PASS |      0 | ucx_perftest tag_bw
      PASS |      0 | ucx_perftest ucp_put_lat
      PASS |      0 | ucx_perftest ucp_put_bw
      PASS |      0 | ucx_perftest ucp_get
      PASS |      0 | openmpi setup
      PASS |      0 | openmpi built with ucx
      PASS |      0 | openmpi ucx osu_bw
Checking for failures and known issues:
  no test failures
Comment 7 errata-xmlrpc 2023-05-09 07:53:35 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (ucx bug fix and enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2023:2408