Bug 1904914
| Summary: | [RDMA/RHEL-8.4] Update mvapich2 to upstream release 2.3.5 | ||
|---|---|---|---|
| Product: | Red Hat Enterprise Linux 8 | Reporter: | Honggang LI <honli> |
| Component: | mvapich2 | Assignee: | Honggang LI <honli> |
| Status: | CLOSED ERRATA | QA Contact: | Afom T. Michael <tmichael> |
| Severity: | unspecified | Docs Contact: | |
| Priority: | unspecified | ||
| Version: | 8.4 | CC: | hwkernel-mgr, rdma-dev-team, tmichael |
| Target Milestone: | rc | Keywords: | Triaged |
| Target Release: | 8.4 | Flags: | pm-rhel:
mirror+
|
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | mvapich2-2.3.5-1.el8 | Doc Type: | If docs needed, set a value |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2021-05-18 14:45:12 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
[root@rdma-virt-01 ~]$ cat /etc/redhat-release
Red Hat Enterprise Linux release 8.4 Beta (Ootpa)
[root@rdma-virt-01 ~]$ uname -r
4.18.0-262.el8.dt4.x86_64
[root@rdma-virt-01 ~]$ rpm -qa | grep -E "rdma|ibverbs|ucx|mvapich2|hwloc"
mpitests-mvapich2-5.7-1.el8.x86_64
libibverbs-32.0-2.el8.x86_64
librdmacm-32.0-2.el8.x86_64
hwloc-libs-2.2.0-1.el8.x86_64
ucx-1.9.0-1.el8.x86_64
rdma-core-devel-32.0-2.el8.x86_64
librdmacm-utils-32.0-2.el8.x86_64
rdma-core-32.0-2.el8.x86_64
libibverbs-utils-32.0-2.el8.x86_64
mvapich2-2.3.5-1.el8.x86_64
[root@rdma-virt-01 ~]$ lspci | grep "Mellanox"
04:00.0 Network controller: Mellanox Technologies MT27520 Family [ConnectX-3 Pro]
05:00.0 Network controller: Mellanox Technologies MT27520 Family [ConnectX-3 Pro]
[root@rdma-virt-01 ~]$ ibstatus
Infiniband device 'mlx4_0' port 1 status:
default gid: fe80:0000:0000:0000:e41d:2d03:001d:6791
base lid: 0x2b
sm lid: 0xd
state: 4: ACTIVE
phys state: 5: LinkUp
rate: 56 Gb/sec (4X FDR)
link_layer: InfiniBand
Infiniband device 'mlx4_0' port 2 status:
default gid: fe80:0000:0000:0001:e41d:2d03:001d:6792
base lid: 0x12
sm lid: 0x1
state: 4: ACTIVE
phys state: 5: LinkUp
rate: 56 Gb/sec (4X FDR)
link_layer: InfiniBand
Infiniband device 'mlx4_1' port 1 status:
default gid: fe80:0000:0000:0000:0202:c9ff:feee:5860
base lid: 0x0
sm lid: 0x0
state: 4: ACTIVE
phys state: 5: LinkUp
rate: 56 Gb/sec (4X FDR)
link_layer: Ethernet
[root@rdma-virt-01 ~]$
+ [20-12-28 23:37:37] dnf install -y --setopt=strict=0 --nogpgcheck mvapich2 mpitests-mvapich2 environment-modules
Updating Subscription Management repositories.
Unable to read consumer identity
This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register.
Last metadata expiration check: 2:25:41 ago on Mon 28 Dec 2020 09:11:57 PM EST.
Package environment-modules-4.5.2-1.el8.x86_64 is already installed.
Dependencies resolved.
================================================================================
Package Architecture Version Repository Size
================================================================================
Installing:
mpitests-mvapich2 x86_64 5.7-1.el8 brew 887 k
mvapich2 x86_64 2.3.5-1.el8 brew 3.8 M
Transaction Summary
================================================================================
Install 2 Packages
Total download size: 4.6 M
Installed size: 22 M
Downloading Packages:
(1/2): mpitests-mvapich2-5.7-1.el8.x86_64.rpm 16 MB/s | 887 kB 00:00
(2/2): mvapich2-2.3.5-1.el8.x86_64.rpm 23 MB/s | 3.8 MB 00:00
--------------------------------------------------------------------------------
Total 28 MB/s | 4.6 MB 00:00
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
Preparing : 1/1
Installing : mvapich2-2.3.5-1.el8.x86_64 1/2
Installing : mpitests-mvapich2-5.7-1.el8.x86_64 2/2
Running scriptlet: mpitests-mvapich2-5.7-1.el8.x86_64 2/2
Verifying : mpitests-mvapich2-5.7-1.el8.x86_64 1/2
Verifying : mvapich2-2.3.5-1.el8.x86_64 2/2
Installed products updated.
Installed:
mpitests-mvapich2-5.7-1.el8.x86_64 mvapich2-2.3.5-1.el8.x86_64
Complete!
[...snip...]
Test results for mpi/mvapich2 on rdma-virt-01:
4.18.0-262.el8.dt4.x86_64, rdma-core-32.0-2.el8, mlx4, ib0, & mlx4_0
Result | Status | Test
---------+--------+------------------------------------
PASS | 0 | mvapich2 IMB-MPI1 PingPong mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 PingPing mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Sendrecv mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Exchange mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Bcast mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Allgather mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Allgatherv mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Gather mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Gatherv mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Scatter mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Scatterv mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Alltoall mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Alltoallv mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Reduce mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Reduce_scatter mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Allreduce mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Barrier mpirun one_core
PASS | 0 | mvapich2 IMB-IO S_Write_indv mpirun one_core
PASS | 0 | mvapich2 IMB-IO S_Read_indv mpirun one_core
PASS | 0 | mvapich2 IMB-IO S_Write_expl mpirun one_core
PASS | 0 | mvapich2 IMB-IO S_Read_expl mpirun one_core
PASS | 0 | mvapich2 IMB-IO P_Write_indv mpirun one_core
PASS | 0 | mvapich2 IMB-IO P_Read_indv mpirun one_core
PASS | 0 | mvapich2 IMB-IO P_Write_expl mpirun one_core
PASS | 0 | mvapich2 IMB-IO P_Read_expl mpirun one_core
PASS | 0 | mvapich2 IMB-IO P_Write_shared mpirun one_core
PASS | 0 | mvapich2 IMB-IO P_Read_shared mpirun one_core
PASS | 0 | mvapich2 IMB-IO P_Write_priv mpirun one_core
PASS | 0 | mvapich2 IMB-IO P_Read_priv mpirun one_core
PASS | 0 | mvapich2 IMB-IO C_Write_indv mpirun one_core
PASS | 0 | mvapich2 IMB-IO C_Read_indv mpirun one_core
PASS | 0 | mvapich2 IMB-IO C_Write_expl mpirun one_core
PASS | 0 | mvapich2 IMB-IO C_Read_expl mpirun one_core
PASS | 0 | mvapich2 IMB-IO C_Write_shared mpirun one_core
PASS | 0 | mvapich2 IMB-IO C_Read_shared mpirun one_core
PASS | 0 | mvapich2 IMB-EXT Window mpirun one_core
PASS | 0 | mvapich2 IMB-EXT Unidir_Put mpirun one_core
PASS | 0 | mvapich2 IMB-EXT Unidir_Get mpirun one_core
PASS | 0 | mvapich2 IMB-EXT Bidir_Get mpirun one_core
PASS | 0 | mvapich2 IMB-EXT Bidir_Put mpirun one_core
PASS | 0 | mvapich2 IMB-EXT Accumulate mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Ibcast mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Iallgather mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Iallgatherv mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Igather mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Igatherv mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Iscatter mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Iscatterv mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Ialltoall mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Ialltoallv mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Ireduce mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Ireduce_scatter mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Iallreduce mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Ibarrier mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Unidir_put mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Unidir_get mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Bidir_put mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Bidir_get mpirun one_core
PASS | 0 | mvapich2 IMB-RMA One_put_all mpirun one_core
PASS | 0 | mvapich2 IMB-RMA One_get_all mpirun one_core
PASS | 0 | mvapich2 IMB-RMA All_put_all mpirun one_core
PASS | 0 | mvapich2 IMB-RMA All_get_all mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Put_local mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Put_all_local mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Exchange_put mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Exchange_get mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Accumulate mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Get_accumulate mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Fetch_and_op mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Compare_and_swap mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Get_local mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Get_all_local mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 PingPong mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 PingPing mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Sendrecv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Exchange mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Bcast mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Allgather mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Allgatherv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Gather mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Gatherv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Scatter mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Scatterv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Alltoall mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Alltoallv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Reduce mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Reduce_scatter mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Allreduce mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Barrier mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO S_Write_indv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO S_Read_indv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO S_Write_expl mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO S_Read_expl mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO P_Write_indv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO P_Read_indv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO P_Write_expl mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO P_Read_expl mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO P_Write_shared mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO P_Read_shared mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO P_Write_priv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO P_Read_priv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO C_Write_indv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO C_Read_indv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO C_Write_expl mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO C_Read_expl mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO C_Write_shared mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO C_Read_shared mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-EXT Window mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-EXT Unidir_Put mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-EXT Unidir_Get mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-EXT Bidir_Get mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-EXT Bidir_Put mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-EXT Accumulate mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Ibcast mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Iallgather mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Iallgatherv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Igather mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Igatherv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Iscatter mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Iscatterv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Ialltoall mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Ialltoallv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Ireduce mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Ireduce_scatter mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Iallreduce mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Ibarrier mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Unidir_put mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Unidir_get mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Bidir_put mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Bidir_get mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA One_put_all mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA One_get_all mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA All_put_all mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA All_get_all mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Put_local mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Put_all_local mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Exchange_put mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Exchange_get mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Accumulate mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Get_accumulate mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Fetch_and_op mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Compare_and_swap mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Get_local mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Get_all_local mpirun_rsh one_core
PASS | 0 | mvapich2 OSU acc_latency mpirun one_core
PASS | 0 | mvapich2 OSU allgather mpirun one_core
PASS | 0 | mvapich2 OSU allgatherv mpirun one_core
PASS | 0 | mvapich2 OSU allreduce mpirun one_core
PASS | 0 | mvapich2 OSU alltoall mpirun one_core
PASS | 0 | mvapich2 OSU alltoallv mpirun one_core
PASS | 0 | mvapich2 OSU barrier mpirun one_core
PASS | 0 | mvapich2 OSU bcast mpirun one_core
PASS | 0 | mvapich2 OSU bibw mpirun one_core
PASS | 0 | mvapich2 OSU bw mpirun one_core
PASS | 0 | mvapich2 OSU cas_latency mpirun one_core
PASS | 0 | mvapich2 OSU fop_latency mpirun one_core
PASS | 0 | mvapich2 OSU gather mpirun one_core
PASS | 0 | mvapich2 OSU gatherv mpirun one_core
PASS | 0 | mvapich2 OSU get_acc_latency mpirun one_core
PASS | 0 | mvapich2 OSU get_bw mpirun one_core
PASS | 0 | mvapich2 OSU get_latency mpirun one_core
PASS | 0 | mvapich2 OSU hello mpirun one_core
PASS | 0 | mvapich2 OSU iallgather mpirun one_core
PASS | 0 | mvapich2 OSU iallgatherv mpirun one_core
PASS | 0 | mvapich2 OSU iallreduce mpirun one_core
PASS | 0 | mvapich2 OSU ialltoall mpirun one_core
PASS | 0 | mvapich2 OSU ialltoallv mpirun one_core
PASS | 0 | mvapich2 OSU ialltoallw mpirun one_core
PASS | 0 | mvapich2 OSU ibarrier mpirun one_core
PASS | 0 | mvapich2 OSU ibcast mpirun one_core
PASS | 0 | mvapich2 OSU igather mpirun one_core
PASS | 0 | mvapich2 OSU igatherv mpirun one_core
PASS | 0 | mvapich2 OSU init mpirun one_core
PASS | 0 | mvapich2 OSU ireduce mpirun one_core
PASS | 0 | mvapich2 OSU iscatter mpirun one_core
PASS | 0 | mvapich2 OSU iscatterv mpirun one_core
PASS | 0 | mvapich2 OSU latency mpirun one_core
PASS | 0 | mvapich2 OSU latency_mp mpirun one_core
PASS | 0 | mvapich2 OSU mbw_mr mpirun one_core
PASS | 0 | mvapich2 OSU multi_lat mpirun one_core
PASS | 0 | mvapich2 OSU put_bibw mpirun one_core
PASS | 0 | mvapich2 OSU put_bw mpirun one_core
PASS | 0 | mvapich2 OSU put_latency mpirun one_core
PASS | 0 | mvapich2 OSU reduce mpirun one_core
PASS | 0 | mvapich2 OSU reduce_scatter mpirun one_core
PASS | 0 | mvapich2 OSU scatter mpirun one_core
PASS | 0 | mvapich2 OSU scatterv mpirun one_core
PASS | 0 | mvapich2 OSU acc_latency mpirun_rsh one_core
PASS | 0 | mvapich2 OSU allgather mpirun_rsh one_core
PASS | 0 | mvapich2 OSU allgatherv mpirun_rsh one_core
PASS | 0 | mvapich2 OSU allreduce mpirun_rsh one_core
PASS | 0 | mvapich2 OSU alltoall mpirun_rsh one_core
PASS | 0 | mvapich2 OSU alltoallv mpirun_rsh one_core
PASS | 0 | mvapich2 OSU barrier mpirun_rsh one_core
PASS | 0 | mvapich2 OSU bcast mpirun_rsh one_core
FAIL | 1 | mvapich2 OSU bibw mpirun_rsh one_core
FAIL | 1 | mvapich2 OSU bw mpirun_rsh one_core
PASS | 0 | mvapich2 OSU cas_latency mpirun_rsh one_core
PASS | 0 | mvapich2 OSU fop_latency mpirun_rsh one_core
PASS | 0 | mvapich2 OSU gather mpirun_rsh one_core
PASS | 0 | mvapich2 OSU gatherv mpirun_rsh one_core
PASS | 0 | mvapich2 OSU get_acc_latency mpirun_rsh one_core
PASS | 0 | mvapich2 OSU get_bw mpirun_rsh one_core
PASS | 0 | mvapich2 OSU get_latency mpirun_rsh one_core
PASS | 0 | mvapich2 OSU hello mpirun_rsh one_core
PASS | 0 | mvapich2 OSU iallgather mpirun_rsh one_core
PASS | 0 | mvapich2 OSU iallgatherv mpirun_rsh one_core
PASS | 0 | mvapich2 OSU iallreduce mpirun_rsh one_core
PASS | 0 | mvapich2 OSU ialltoall mpirun_rsh one_core
PASS | 0 | mvapich2 OSU ialltoallv mpirun_rsh one_core
PASS | 0 | mvapich2 OSU ialltoallw mpirun_rsh one_core
PASS | 0 | mvapich2 OSU ibarrier mpirun_rsh one_core
PASS | 0 | mvapich2 OSU ibcast mpirun_rsh one_core
PASS | 0 | mvapich2 OSU igather mpirun_rsh one_core
PASS | 0 | mvapich2 OSU igatherv mpirun_rsh one_core
PASS | 0 | mvapich2 OSU init mpirun_rsh one_core
PASS | 0 | mvapich2 OSU ireduce mpirun_rsh one_core
PASS | 0 | mvapich2 OSU iscatter mpirun_rsh one_core
PASS | 0 | mvapich2 OSU iscatterv mpirun_rsh one_core
PASS | 0 | mvapich2 OSU latency mpirun_rsh one_core
FAIL | 1 | mvapich2 OSU latency_mp mpirun_rsh one_core
FAIL | 1 | mvapich2 OSU mbw_mr mpirun_rsh one_core
PASS | 0 | mvapich2 OSU multi_lat mpirun_rsh one_core
PASS | 0 | mvapich2 OSU put_bibw mpirun_rsh one_core
PASS | 0 | mvapich2 OSU put_bw mpirun_rsh one_core
PASS | 0 | mvapich2 OSU put_latency mpirun_rsh one_core
PASS | 0 | mvapich2 OSU reduce mpirun_rsh one_core
PASS | 0 | mvapich2 OSU reduce_scatter mpirun_rsh one_core
PASS | 0 | mvapich2 OSU scatter mpirun_rsh one_core
PASS | 0 | mvapich2 OSU scatterv mpirun_rsh one_core
Moving to verified as recent RHEL-8.4 build has mvapich2-2.3.5-1 and our test passed as shown below.
[root@rdma-qe-07 ~]$ cat /etc/redhat-release
Red Hat Enterprise Linux release 8.4 Beta (Ootpa)
[root@rdma-qe-07 ~]$ uname -r
4.18.0-269.el8.x86_64
[root@rdma-qe-07 ~]$ rpm -qa | grep -E "rdma|mvapich|openmpi|ucx|infiniband|ibverbs|hwloc"
mvapich2-2.3.5-1.el8.x86_64
ucx-1.9.0-1.el8.x86_64
ucx-cma-1.9.0-1.el8.x86_64
rdma-core-devel-32.0-3.el8.x86_64
librdmacm-utils-32.0-3.el8.x86_64
rdma-core-32.0-3.el8.x86_64
infiniband-diags-32.0-3.el8.x86_64
ucx-rdmacm-1.9.0-1.el8.x86_64
mpitests-mvapich2-5.7-1.el8.x86_64
libibverbs-32.0-3.el8.x86_64
ucx-ib-1.9.0-1.el8.x86_64
librdmacm-32.0-3.el8.x86_64
hwloc-libs-2.2.0-1.el8.x86_64
libibverbs-utils-32.0-3.el8.x86_64
[root@rdma-qe-07 ~]$ lspci | grep -i "Mellanox"
05:00.0 Infiniband controller: Mellanox Technologies MT27600 [Connect-IB]
[root@rdma-qe-07 ~]$ ibv_devices
device node GUID
------ ----------------
mlx5_0 f452140300085d60
[root@rdma-qe-07 ~]$ ibv_devinfo
hca_id: mlx5_0
transport: InfiniBand (0)
fw_ver: 10.16.1200
node_guid: f452:1403:0008:5d60
sys_image_guid: f452:1403:0008:5d60
vendor_id: 0x02c9
vendor_part_id: 4113
hw_ver: 0x0
board_id: MT_1210110019
phys_port_cnt: 2
port: 1
state: PORT_ACTIVE (4)
max_mtu: 4096 (5)
active_mtu: 4096 (5)
sm_lid: 13
port_lid: 1
port_lmc: 0x00
link_layer: InfiniBand
port: 2
state: PORT_ACTIVE (4)
max_mtu: 4096 (5)
active_mtu: 4096 (5)
sm_lid: 1
port_lid: 12
port_lmc: 0x00
link_layer: InfiniBand
[root@rdma-qe-07 ~]$ ibstatus
Infiniband device 'mlx5_0' port 1 status:
default gid: fe80:0000:0000:0000:f452:1403:0008:5d60
base lid: 0x1
sm lid: 0xd
state: 4: ACTIVE
phys state: 5: LinkUp
rate: 56 Gb/sec (4X FDR)
link_layer: InfiniBand
Infiniband device 'mlx5_0' port 2 status:
default gid: fe80:0000:0000:0001:f452:1403:0008:5d68
base lid: 0xc
sm lid: 0x1
state: 4: ACTIVE
phys state: 5: LinkUp
rate: 56 Gb/sec (4X FDR)
link_layer: InfiniBand
[root@rdma-qe-07 ~]$
[...snip...]
dnf install -y --setopt=strict=0 --nogpgcheck mvapich2 mpitests-mvapich2 environment-modules
[...snip...]
Last metadata expiration check: 20:46:17 ago on Wed 06 Jan 2021 09:39:36 PM EST.
Package environment-modules-4.5.2-1.el8.x86_64 is already installed.
Dependencies resolved.
================================================================================
Package Arch Version Repository Size
================================================================================
Installing:
mpitests-mvapich2 x86_64 5.7-1.el8 beaker-AppStream 889 k
mvapich2 x86_64 2.3.5-1.el8 beaker-AppStream 3.8 M
Transaction Summary
================================================================================
Install 2 Packages
Total download size: 4.6 M
Installed size: 22 M
Downloading Packages:
(1/2): mpitests-mvapich2-5.7-1.el8.x86_64.rpm 19 MB/s | 889 kB 00:00
(2/2): mvapich2-2.3.5-1.el8.x86_64.rpm 27 MB/s | 3.8 MB 00:00
--------------------------------------------------------------------------------
Total 33 MB/s | 4.6 MB 00:00
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
Preparing : 1/1
Installing : mvapich2-2.3.5-1.el8.x86_64 1/2
Installing : mpitests-mvapich2-5.7-1.el8.x86_64 2/2
Running scriptlet: mpitests-mvapich2-5.7-1.el8.x86_64 2/2
Verifying : mpitests-mvapich2-5.7-1.el8.x86_64 1/2
Verifying : mvapich2-2.3.5-1.el8.x86_64 2/2
Installed products updated.
Installed:
mpitests-mvapich2-5.7-1.el8.x86_64 mvapich2-2.3.5-1.el8.x86_64
Complete!
[...snip...]
Test results for mpi/mvapich2 on rdma-qe-07:
4.18.0-269.el8.x86_64, rdma-core-32.0-3.el8, mlx5, ib0, & mlx5_0
Result | Status | Test
---------+--------+------------------------------------
PASS | 0 | mvapich2 IMB-MPI1 PingPong mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 PingPing mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Sendrecv mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Exchange mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Bcast mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Allgather mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Allgatherv mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Gather mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Gatherv mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Scatter mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Scatterv mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Alltoall mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Alltoallv mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Reduce mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Reduce_scatter mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Allreduce mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 Barrier mpirun one_core
PASS | 0 | mvapich2 IMB-IO S_Write_indv mpirun one_core
PASS | 0 | mvapich2 IMB-IO S_Read_indv mpirun one_core
PASS | 0 | mvapich2 IMB-IO S_Write_expl mpirun one_core
PASS | 0 | mvapich2 IMB-IO S_Read_expl mpirun one_core
PASS | 0 | mvapich2 IMB-IO P_Write_indv mpirun one_core
PASS | 0 | mvapich2 IMB-IO P_Read_indv mpirun one_core
PASS | 0 | mvapich2 IMB-IO P_Write_expl mpirun one_core
PASS | 0 | mvapich2 IMB-IO P_Read_expl mpirun one_core
PASS | 0 | mvapich2 IMB-IO P_Write_shared mpirun one_core
PASS | 0 | mvapich2 IMB-IO P_Read_shared mpirun one_core
PASS | 0 | mvapich2 IMB-IO P_Write_priv mpirun one_core
PASS | 0 | mvapich2 IMB-IO P_Read_priv mpirun one_core
PASS | 0 | mvapich2 IMB-IO C_Write_indv mpirun one_core
PASS | 0 | mvapich2 IMB-IO C_Read_indv mpirun one_core
PASS | 0 | mvapich2 IMB-IO C_Write_expl mpirun one_core
PASS | 0 | mvapich2 IMB-IO C_Read_expl mpirun one_core
PASS | 0 | mvapich2 IMB-IO C_Write_shared mpirun one_core
PASS | 0 | mvapich2 IMB-IO C_Read_shared mpirun one_core
PASS | 0 | mvapich2 IMB-EXT Window mpirun one_core
PASS | 0 | mvapich2 IMB-EXT Unidir_Put mpirun one_core
PASS | 0 | mvapich2 IMB-EXT Unidir_Get mpirun one_core
PASS | 0 | mvapich2 IMB-EXT Bidir_Get mpirun one_core
PASS | 0 | mvapich2 IMB-EXT Bidir_Put mpirun one_core
PASS | 0 | mvapich2 IMB-EXT Accumulate mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Ibcast mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Iallgather mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Iallgatherv mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Igather mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Igatherv mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Iscatter mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Iscatterv mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Ialltoall mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Ialltoallv mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Ireduce mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Ireduce_scatter mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Iallreduce mpirun one_core
PASS | 0 | mvapich2 IMB-NBC Ibarrier mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Unidir_put mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Unidir_get mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Bidir_put mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Bidir_get mpirun one_core
PASS | 0 | mvapich2 IMB-RMA One_put_all mpirun one_core
PASS | 0 | mvapich2 IMB-RMA One_get_all mpirun one_core
PASS | 0 | mvapich2 IMB-RMA All_put_all mpirun one_core
PASS | 0 | mvapich2 IMB-RMA All_get_all mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Put_local mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Put_all_local mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Exchange_put mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Exchange_get mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Accumulate mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Get_accumulate mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Fetch_and_op mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Compare_and_swap mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Get_local mpirun one_core
PASS | 0 | mvapich2 IMB-RMA Get_all_local mpirun one_core
PASS | 0 | mvapich2 IMB-MPI1 PingPong mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 PingPing mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Sendrecv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Exchange mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Bcast mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Allgather mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Allgatherv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Gather mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Gatherv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Scatter mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Scatterv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Alltoall mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Alltoallv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Reduce mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Reduce_scatter mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Allreduce mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-MPI1 Barrier mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO S_Write_indv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO S_Read_indv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO S_Write_expl mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO S_Read_expl mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO P_Write_indv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO P_Read_indv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO P_Write_expl mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO P_Read_expl mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO P_Write_shared mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO P_Read_shared mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO P_Write_priv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO P_Read_priv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO C_Write_indv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO C_Read_indv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO C_Write_expl mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO C_Read_expl mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO C_Write_shared mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-IO C_Read_shared mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-EXT Window mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-EXT Unidir_Put mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-EXT Unidir_Get mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-EXT Bidir_Get mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-EXT Bidir_Put mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-EXT Accumulate mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Ibcast mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Iallgather mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Iallgatherv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Igather mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Igatherv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Iscatter mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Iscatterv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Ialltoall mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Ialltoallv mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Ireduce mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Ireduce_scatter mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Iallreduce mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-NBC Ibarrier mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Unidir_put mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Unidir_get mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Bidir_put mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Bidir_get mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA One_put_all mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA One_get_all mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA All_put_all mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA All_get_all mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Put_local mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Put_all_local mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Exchange_put mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Exchange_get mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Accumulate mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Get_accumulate mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Fetch_and_op mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Compare_and_swap mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Get_local mpirun_rsh one_core
PASS | 0 | mvapich2 IMB-RMA Get_all_local mpirun_rsh one_core
PASS | 0 | mvapich2 OSU acc_latency mpirun one_core
PASS | 0 | mvapich2 OSU allgather mpirun one_core
PASS | 0 | mvapich2 OSU allgatherv mpirun one_core
PASS | 0 | mvapich2 OSU allreduce mpirun one_core
PASS | 0 | mvapich2 OSU alltoall mpirun one_core
PASS | 0 | mvapich2 OSU alltoallv mpirun one_core
PASS | 0 | mvapich2 OSU barrier mpirun one_core
PASS | 0 | mvapich2 OSU bcast mpirun one_core
PASS | 0 | mvapich2 OSU bibw mpirun one_core
PASS | 0 | mvapich2 OSU bw mpirun one_core
PASS | 0 | mvapich2 OSU cas_latency mpirun one_core
PASS | 0 | mvapich2 OSU fop_latency mpirun one_core
PASS | 0 | mvapich2 OSU gather mpirun one_core
PASS | 0 | mvapich2 OSU gatherv mpirun one_core
PASS | 0 | mvapich2 OSU get_acc_latency mpirun one_core
PASS | 0 | mvapich2 OSU get_bw mpirun one_core
PASS | 0 | mvapich2 OSU get_latency mpirun one_core
PASS | 0 | mvapich2 OSU hello mpirun one_core
PASS | 0 | mvapich2 OSU iallgather mpirun one_core
PASS | 0 | mvapich2 OSU iallgatherv mpirun one_core
PASS | 0 | mvapich2 OSU iallreduce mpirun one_core
PASS | 0 | mvapich2 OSU ialltoall mpirun one_core
PASS | 0 | mvapich2 OSU ialltoallv mpirun one_core
PASS | 0 | mvapich2 OSU ialltoallw mpirun one_core
PASS | 0 | mvapich2 OSU ibarrier mpirun one_core
PASS | 0 | mvapich2 OSU ibcast mpirun one_core
PASS | 0 | mvapich2 OSU igather mpirun one_core
PASS | 0 | mvapich2 OSU igatherv mpirun one_core
PASS | 0 | mvapich2 OSU init mpirun one_core
PASS | 0 | mvapich2 OSU ireduce mpirun one_core
PASS | 0 | mvapich2 OSU iscatter mpirun one_core
PASS | 0 | mvapich2 OSU iscatterv mpirun one_core
PASS | 0 | mvapich2 OSU latency mpirun one_core
PASS | 0 | mvapich2 OSU latency_mp mpirun one_core
PASS | 0 | mvapich2 OSU mbw_mr mpirun one_core
PASS | 0 | mvapich2 OSU multi_lat mpirun one_core
PASS | 0 | mvapich2 OSU put_bibw mpirun one_core
PASS | 0 | mvapich2 OSU put_bw mpirun one_core
PASS | 0 | mvapich2 OSU put_latency mpirun one_core
PASS | 0 | mvapich2 OSU reduce mpirun one_core
PASS | 0 | mvapich2 OSU reduce_scatter mpirun one_core
PASS | 0 | mvapich2 OSU scatter mpirun one_core
PASS | 0 | mvapich2 OSU scatterv mpirun one_core
PASS | 0 | mvapich2 OSU acc_latency mpirun_rsh one_core
PASS | 0 | mvapich2 OSU allgather mpirun_rsh one_core
PASS | 0 | mvapich2 OSU allgatherv mpirun_rsh one_core
PASS | 0 | mvapich2 OSU allreduce mpirun_rsh one_core
PASS | 0 | mvapich2 OSU alltoall mpirun_rsh one_core
PASS | 0 | mvapich2 OSU alltoallv mpirun_rsh one_core
PASS | 0 | mvapich2 OSU barrier mpirun_rsh one_core
PASS | 0 | mvapich2 OSU bcast mpirun_rsh one_core
PASS | 0 | mvapich2 OSU bibw mpirun_rsh one_core
PASS | 0 | mvapich2 OSU bw mpirun_rsh one_core
PASS | 0 | mvapich2 OSU cas_latency mpirun_rsh one_core
PASS | 0 | mvapich2 OSU fop_latency mpirun_rsh one_core
PASS | 0 | mvapich2 OSU gather mpirun_rsh one_core
PASS | 0 | mvapich2 OSU gatherv mpirun_rsh one_core
PASS | 0 | mvapich2 OSU get_acc_latency mpirun_rsh one_core
PASS | 0 | mvapich2 OSU get_bw mpirun_rsh one_core
PASS | 0 | mvapich2 OSU get_latency mpirun_rsh one_core
PASS | 0 | mvapich2 OSU hello mpirun_rsh one_core
PASS | 0 | mvapich2 OSU iallgather mpirun_rsh one_core
PASS | 0 | mvapich2 OSU iallgatherv mpirun_rsh one_core
PASS | 0 | mvapich2 OSU iallreduce mpirun_rsh one_core
PASS | 0 | mvapich2 OSU ialltoall mpirun_rsh one_core
PASS | 0 | mvapich2 OSU ialltoallv mpirun_rsh one_core
PASS | 0 | mvapich2 OSU ialltoallw mpirun_rsh one_core
PASS | 0 | mvapich2 OSU ibarrier mpirun_rsh one_core
PASS | 0 | mvapich2 OSU ibcast mpirun_rsh one_core
PASS | 0 | mvapich2 OSU igather mpirun_rsh one_core
PASS | 0 | mvapich2 OSU igatherv mpirun_rsh one_core
PASS | 0 | mvapich2 OSU init mpirun_rsh one_core
PASS | 0 | mvapich2 OSU ireduce mpirun_rsh one_core
PASS | 0 | mvapich2 OSU iscatter mpirun_rsh one_core
PASS | 0 | mvapich2 OSU iscatterv mpirun_rsh one_core
PASS | 0 | mvapich2 OSU latency mpirun_rsh one_core
FAIL | 1 | mvapich2 OSU latency_mp mpirun_rsh one_core
PASS | 0 | mvapich2 OSU mbw_mr mpirun_rsh one_core
PASS | 0 | mvapich2 OSU multi_lat mpirun_rsh one_core
PASS | 0 | mvapich2 OSU put_bibw mpirun_rsh one_core
PASS | 0 | mvapich2 OSU put_bw mpirun_rsh one_core
PASS | 0 | mvapich2 OSU put_latency mpirun_rsh one_core
PASS | 0 | mvapich2 OSU reduce mpirun_rsh one_core
PASS | 0 | mvapich2 OSU reduce_scatter mpirun_rsh one_core
PASS | 0 | mvapich2 OSU scatter mpirun_rsh one_core
PASS | 0 | mvapich2 OSU scatterv mpirun_rsh one_core
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (RDMA stack bug fix and enhancement update), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2021:1594 |
Description of problem: MVAPICH2 2.3.5 GA was released on 1 Dec 2020. This has a lot of bug fixes and performance enhancements. The new release supports Broadcom NetXtreme RoCE HCA. Version-Release number of selected component (if applicable): upstream release 2.3.5 How reproducible: Steps to Reproduce: 1. 2. 3. Actual results: Expected results: Additional info: [mvapich] Announcing the Release of MVAPICH2 2.3.5 GA The MVAPICH team is pleased to announce the release of MVAPICH2 2.3.5 GA. Features and enhancements for MVAPICH2 2.3.5 GA are as follows: * Features and Enhancements (since 2.3.4): - Enhanced performance for MPI_Allreduce and MPI_Barrier - Support collective offload using Mellanox's SHARP for Barrier - Enhanced tuning framework for Barrier using SHARP - Remove dependency on underlying libibverbs, libibmad, libibumad, and librdmacm libraries using dlopen - Add support for Broadcom NetXtreme RoCE HCA - Enhanced inter-node point-to-point support - Support architecture detection for Fujitsu A64fx processor - Enhanced point-to-point and collective tuning for Fujitsu A64fx proce= ssor - Enhanced point-to-point and collective tuning for AMD ROME processor - Add support for process placement aware HCA selection - Add "MV2_PROCESS_PLACEMENT_AWARE_HCA_MAPPING" environment variabl= e to enable process placement aware HCA mapping - Add support to select HWLOC v1 and HWLOC v2 at configure time - Select using configure time flag --with-hwloc=3Dversion - Takes options of v1 (default) and v2 - Add support to auto-detect RoCE HCAs and auto-detect GID index - Add support to use RoCE/Ethernet and InfiniBand HCAs at the same time - Add architecture-specific flags to improve performance of certain CUD= A operations - Thanks to Chris Chambreau @LLNL for the report - Read MTU and maximum outstanding RDMA operations from the device - Improved performance and scalability for UD-based communication - Update maximum HCAs supported by default from 4 to 10 - Enhanced collective tuning for Frontera@TACC, Expanse@SDSC, Ookami@StonyBrook, and bb5@EPFL - Enhanced support for SHARP v2.1.0 - Generalize code for GPU support - Update hwloc v2 code to v2.3.0 * Bug Fixes (since 2.3.4): - Fix issue with mpiexec+PBS when calling MPI_Abort - Thanks to Matthew W. Anderson @INL for the report and initial pat= ch - Fix validation failure with multi-threaded applications when InfiniBa= nd registration cache is enabled. - Thanks to Alexander Melnikov for the report and initial patch - Fix issue with realloc when InfiniBand registration cache is enabled - Thanks to Si Lu @TACC and Viet-Duc Le @KISTI for reporting the is= sue - Fix out of tree builds for ROMIO - Thanks to Per Berg @Defense Center for Operative Oceanography, De= nmark for the report - Fix integer overflow errors in the collective code path - Thanks to Kiran Ravikumar @GaTech for the report and reproducer - Fix issue with Hybrid+Spread mapping on hyper-threaded systems - Fix out-of-memory issue when allocating CUDA events - Fix issue with large message UD transfers where packets were incorrec= tly marked as dropped/missing - Fix spelling mistakes - Thanks to Jens Schleusener @fossies.org for the report - Revert changes which caused dependencies on lex/yacc at configure tim= e - Thanks to Daniel Pou @HPE for the report - Fix issues with UD Zcopy data transfers - Fix issues with handling datatypes in the collective code - Revert moving -lmpi, -lmpicxx, and -lmpifort before other LDFLAGS in compiler wrappers like mpicc, mpicxx, mpif77, and mpif90 - This was causing issues with certain legacy applications - Thanks to Nicolas Morey-Chaisemartin @SUSE for the report - Fix compilation warnings and memory leaks MVAPICH2 2.3.5 delivers impressive performance and scalability. Some highli= ghts from recent runs on the TACC Frontera system include: - Complete job startup in only 31 seconds for 229,376 processes on 4,0= 96 nodes with 56 processes per node. - Improvement in the latency of MPI_Bcast by up to a factor of two at 2,048 nodes while using InfiniBand hardware-based multicast suppo= rt. - Accelerated performance of MPI_Allreduce, MPI_Reduce, and MPI_Barrie= r at 7,861 nodes (full system scale) by a factor of 5.1, 5.2, and 7.1, respectively, by using SHARP.