Bug 2212011

Summary: [RHEL-8.9] Update mpich package
Product: Red Hat Enterprise Linux 8 Reporter: Kamal Heib <kheib>
Component: mpichAssignee: Kamal Heib <kheib>
Status: VERIFIED --- QA Contact: Afom T. Michael <tmichael>
Severity: medium Docs Contact:
Priority: unspecified    
Version: 8.9CC: hwkernel-mgr, rdma-dev-team, tmichael
Target Milestone: rcKeywords: Triaged
Target Release: 8.9   
Hardware: Unspecified   
OS: Linux   
Whiteboard:
Fixed In Version: mpich-4.1.1-1.el8 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: Type: Component Upgrade
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Kamal Heib 2023-06-03 00:55:45 UTC 
Description of problem:
Update mpich for rhel-8.9 release

Version-Release number of selected component (if applicable):
4.1.1

How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:
Comment 1 Afom T. Michael 2023-06-10 19:44:40 UTC 
mpich test passed and marking this as "Verified: Tested".

[root@rdma-qe-41 ~]$ cat /etc/redhat-release 
Red Hat Enterprise Linux release 8.9 Beta (Ootpa)
[root@rdma-qe-41 ~]$ grep DISTRO /etc/motd | uniq | tr -d " "
DISTRO=RHEL-8.9.0-20230530.25
[root@rdma-qe-41 ~]$ rpm -qa | grep -E "rdma|infiniband|ucx|mpi|libibverbs"
ucx-cma-1.14.1-1.el8.1.x86_64
ucx-ib-1.14.1-1.el8.1.x86_64
librdmacm-44.0-2.el8.1.x86_64
libibverbs-utils-44.0-2.el8.1.x86_64
infiniband-diags-44.0-2.el8.1.x86_64
ucx-1.14.1-1.el8.1.x86_64
ucx-rdmacm-1.14.1-1.el8.1.x86_64
rdma-core-devel-44.0-2.el8.1.x86_64
librdmacm-utils-44.0-2.el8.1.x86_64
rdma-core-44.0-2.el8.1.x86_64
mpitests-mvapich2-5.8-1.el8.x86_64
ucx-devel-1.14.1-1.el8.1.x86_64
compiler-rt-15.0.7-1.module+el8.8.0+17939+b58878af.x86_64
libibverbs-44.0-2.el8.1.x86_64
rpm-mpi-hooks-8-2.el8.noarch
[root@rdma-qe-41 ~]$

[...snip...]
Installed:
  mpich-4.1.1-1.el8.x86_64              mpich-autoload-4.1.1-1.el8.x86_64       
  mpich-devel-4.1.1-1.el8.x86_64        mpitests-mpich-5.8-1.el8.x86_64         

[...snip...]

mpi/mpich2 test results on rdma-qe-40/rdma-qe-41 & Beaker job J:7959728:
4.18.0-494.el8.x86_64, rdma-core-44.0-2.el8.1, mlx5, roce.45, ConnectX-7 & mlx5_1
    Result | Status | Test
  ---------+--------+------------------------------------
      PASS |      0 | mpich OSU acc_latency mpiexec one_core
      PASS |      0 | mpich OSU allgather mpiexec one_core
      PASS |      0 | mpich OSU allgatherv mpiexec one_core
      PASS |      0 | mpich OSU allreduce mpiexec one_core
      PASS |      0 | mpich OSU alltoall mpiexec one_core
      PASS |      0 | mpich OSU alltoallv mpiexec one_core
      PASS |      0 | mpich OSU barrier mpiexec one_core
      PASS |      0 | mpich OSU bcast mpiexec one_core
      PASS |      0 | mpich OSU bibw mpiexec one_core
      PASS |      0 | mpich OSU bw mpiexec one_core
      PASS |      0 | mpich OSU cas_latency mpiexec one_core
      PASS |      0 | mpich OSU fop_latency mpiexec one_core
      PASS |      0 | mpich OSU gather mpiexec one_core
      PASS |      0 | mpich OSU gatherv mpiexec one_core
      PASS |      0 | mpich OSU get_acc_latency mpiexec one_core
      PASS |      0 | mpich OSU get_bw mpiexec one_core
      PASS |      0 | mpich OSU get_latency mpiexec one_core
      PASS |      0 | mpich OSU hello mpiexec one_core
      PASS |      0 | mpich OSU iallgather mpiexec one_core
      PASS |      0 | mpich OSU iallgatherv mpiexec one_core
      PASS |      0 | mpich OSU iallreduce mpiexec one_core
      PASS |      0 | mpich OSU ialltoall mpiexec one_core
      PASS |      0 | mpich OSU ialltoallv mpiexec one_core
      PASS |      0 | mpich OSU ialltoallw mpiexec one_core
      PASS |      0 | mpich OSU ibarrier mpiexec one_core
      PASS |      0 | mpich OSU ibcast mpiexec one_core
      PASS |      0 | mpich OSU igather mpiexec one_core
      PASS |      0 | mpich OSU igatherv mpiexec one_core
      PASS |      0 | mpich OSU init mpiexec one_core
      PASS |      0 | mpich OSU ireduce mpiexec one_core
      PASS |      0 | mpich OSU iscatter mpiexec one_core
      PASS |      0 | mpich OSU iscatterv mpiexec one_core
      PASS |      0 | mpich OSU latency mpiexec one_core
      PASS |      0 | mpich OSU latency_mp mpiexec one_core
      PASS |      0 | mpich OSU mbw_mr mpiexec one_core
      PASS |      0 | mpich OSU multi_lat mpiexec one_core
      PASS |      0 | mpich OSU put_bibw mpiexec one_core
      PASS |      0 | mpich OSU put_bw mpiexec one_core
      PASS |      0 | mpich OSU put_latency mpiexec one_core
      PASS |      0 | mpich OSU reduce mpiexec one_core
      PASS |      0 | mpich OSU reduce_scatter mpiexec one_core
      PASS |      0 | mpich OSU scatter mpiexec one_core
      PASS |      0 | mpich OSU scatterv mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 PingPong mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 PingPing mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Sendrecv mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Exchange mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Bcast mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Allgather mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Allgatherv mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Gather mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Gatherv mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Scatter mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Scatterv mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Alltoall mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Alltoallv mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Reduce mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Reduce_scatter mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Allreduce mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Barrier mpiexec one_core
      PASS |      0 | mpich IMB-IO S_Write_indv mpiexec one_core
      PASS |      0 | mpich IMB-IO S_Read_indv mpiexec one_core
      PASS |      0 | mpich IMB-IO S_Write_expl mpiexec one_core
      PASS |      0 | mpich IMB-IO S_Read_expl mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Write_indv mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Read_indv mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Write_expl mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Read_expl mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Write_shared mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Read_shared mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Write_priv mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Read_priv mpiexec one_core
      PASS |      0 | mpich IMB-IO C_Write_indv mpiexec one_core
      PASS |      0 | mpich IMB-IO C_Read_indv mpiexec one_core
      PASS |      0 | mpich IMB-IO C_Write_expl mpiexec one_core
      PASS |      0 | mpich IMB-IO C_Read_expl mpiexec one_core
      PASS |      0 | mpich IMB-IO C_Write_shared mpiexec one_core
      PASS |      0 | mpich IMB-IO C_Read_shared mpiexec one_core
      PASS |      0 | mpich IMB-EXT Window mpiexec one_core
      PASS |      0 | mpich IMB-EXT Unidir_Put mpiexec one_core
      PASS |      0 | mpich IMB-EXT Unidir_Get mpiexec one_core
      PASS |      0 | mpich IMB-EXT Bidir_Get mpiexec one_core
      PASS |      0 | mpich IMB-EXT Bidir_Put mpiexec one_core
      PASS |      0 | mpich IMB-EXT Accumulate mpiexec one_core
      PASS |      0 | mpich IMB-NBC Ibcast mpiexec one_core
      PASS |      0 | mpich IMB-NBC Iallgather mpiexec one_core
      PASS |      0 | mpich IMB-NBC Iallgatherv mpiexec one_core
      PASS |      0 | mpich IMB-NBC Igather mpiexec one_core
      PASS |      0 | mpich IMB-NBC Igatherv mpiexec one_core
      PASS |      0 | mpich IMB-NBC Iscatter mpiexec one_core
      PASS |      0 | mpich IMB-NBC Iscatterv mpiexec one_core
      PASS |      0 | mpich IMB-NBC Ialltoall mpiexec one_core
      PASS |      0 | mpich IMB-NBC Ialltoallv mpiexec one_core
      PASS |      0 | mpich IMB-NBC Ireduce mpiexec one_core
      PASS |      0 | mpich IMB-NBC Ireduce_scatter mpiexec one_core
      PASS |      0 | mpich IMB-NBC Iallreduce mpiexec one_core
      PASS |      0 | mpich IMB-NBC Ibarrier mpiexec one_core
      PASS |      0 | mpich IMB-RMA Unidir_put mpiexec one_core
      PASS |      0 | mpich IMB-RMA Unidir_get mpiexec one_core
      PASS |      0 | mpich IMB-RMA Bidir_put mpiexec one_core
      PASS |      0 | mpich IMB-RMA Bidir_get mpiexec one_core
      PASS |      0 | mpich IMB-RMA One_put_all mpiexec one_core
      PASS |      0 | mpich IMB-RMA One_get_all mpiexec one_core
      PASS |      0 | mpich IMB-RMA All_put_all mpiexec one_core
      PASS |      0 | mpich IMB-RMA All_get_all mpiexec one_core
      PASS |      0 | mpich IMB-RMA Put_local mpiexec one_core
      PASS |      0 | mpich IMB-RMA Put_all_local mpiexec one_core
      PASS |      0 | mpich IMB-RMA Exchange_put mpiexec one_core
      PASS |      0 | mpich IMB-RMA Exchange_get mpiexec one_core
      PASS |      0 | mpich IMB-RMA Accumulate mpiexec one_core
      PASS |      0 | mpich IMB-RMA Get_accumulate mpiexec one_core
      PASS |      0 | mpich IMB-RMA Fetch_and_op mpiexec one_core
      PASS |      0 | mpich IMB-RMA Compare_and_swap mpiexec one_core
      PASS |      0 | mpich IMB-RMA Get_local mpiexec one_core
      PASS |      0 | mpich IMB-RMA Get_all_local mpiexec one_core
Checking for failures and known issues:
  no test failures
Comment 4 Afom T. Michael 2023-06-29 04:45:40 UTC 
RHEL-8.9 includes mpich-4.1.1-1.el8.x86_64 and tests have passed. Hence, marking this as 'Verified'.

Installed:
  mpich-4.1.1-1.el8.x86_64            mpitests-mpich-5.8-1.el8.x86_64  

mpi-mpich2 test results on rdma-perf-00/rdma-perf-01 & Beaker job J:8018960:
4.18.0-499.el8.x86_64, rdma-core-44.0-2.el8.1, mlx4, ib0, ConnectX-3 & mlx4_0
    Result | Status | Test
  ---------+--------+------------------------------------
      PASS |      0 | mpich OSU acc_latency mpiexec one_core
      PASS |      0 | mpich OSU allgather mpiexec one_core
      PASS |      0 | mpich OSU allgatherv mpiexec one_core
      PASS |      0 | mpich OSU allreduce mpiexec one_core
      PASS |      0 | mpich OSU alltoall mpiexec one_core
      PASS |      0 | mpich OSU alltoallv mpiexec one_core
      PASS |      0 | mpich OSU barrier mpiexec one_core
      PASS |      0 | mpich OSU bcast mpiexec one_core
      PASS |      0 | mpich OSU bibw mpiexec one_core
      PASS |      0 | mpich OSU bw mpiexec one_core
      PASS |      0 | mpich OSU cas_latency mpiexec one_core
      PASS |      0 | mpich OSU fop_latency mpiexec one_core
      PASS |      0 | mpich OSU gather mpiexec one_core
      PASS |      0 | mpich OSU gatherv mpiexec one_core
      PASS |      0 | mpich OSU get_acc_latency mpiexec one_core
      PASS |      0 | mpich OSU get_bw mpiexec one_core
      PASS |      0 | mpich OSU get_latency mpiexec one_core
      PASS |      0 | mpich OSU hello mpiexec one_core
      PASS |      0 | mpich OSU iallgather mpiexec one_core
      PASS |      0 | mpich OSU iallgatherv mpiexec one_core
      PASS |      0 | mpich OSU iallreduce mpiexec one_core
      PASS |      0 | mpich OSU ialltoall mpiexec one_core
      PASS |      0 | mpich OSU ialltoallv mpiexec one_core
      PASS |      0 | mpich OSU ialltoallw mpiexec one_core
      PASS |      0 | mpich OSU ibarrier mpiexec one_core
      PASS |      0 | mpich OSU ibcast mpiexec one_core
      PASS |      0 | mpich OSU igather mpiexec one_core
      PASS |      0 | mpich OSU igatherv mpiexec one_core
      PASS |      0 | mpich OSU init mpiexec one_core
      PASS |      0 | mpich OSU ireduce mpiexec one_core
      PASS |      0 | mpich OSU iscatter mpiexec one_core
      PASS |      0 | mpich OSU iscatterv mpiexec one_core
      PASS |      0 | mpich OSU latency mpiexec one_core
      PASS |      0 | mpich OSU latency_mp mpiexec one_core
      PASS |      0 | mpich OSU mbw_mr mpiexec one_core
      PASS |      0 | mpich OSU multi_lat mpiexec one_core
      PASS |      0 | mpich OSU put_bibw mpiexec one_core
      PASS |      0 | mpich OSU put_bw mpiexec one_core
      PASS |      0 | mpich OSU put_latency mpiexec one_core
      PASS |      0 | mpich OSU reduce mpiexec one_core
      PASS |      0 | mpich OSU reduce_scatter mpiexec one_core
      PASS |      0 | mpich OSU scatter mpiexec one_core
      PASS |      0 | mpich OSU scatterv mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 PingPong mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 PingPing mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Sendrecv mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Exchange mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Bcast mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Allgather mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Allgatherv mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Gather mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Gatherv mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Scatter mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Scatterv mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Alltoall mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Alltoallv mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Reduce mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Reduce_scatter mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Allreduce mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Barrier mpiexec one_core
      PASS |      0 | mpich IMB-IO S_Write_indv mpiexec one_core
      PASS |      0 | mpich IMB-IO S_Read_indv mpiexec one_core
      PASS |      0 | mpich IMB-IO S_Write_expl mpiexec one_core
      PASS |      0 | mpich IMB-IO S_Read_expl mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Write_indv mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Read_indv mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Write_expl mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Read_expl mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Write_shared mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Read_shared mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Write_priv mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Read_priv mpiexec one_core
      PASS |      0 | mpich IMB-IO C_Write_indv mpiexec one_core
      PASS |      0 | mpich IMB-IO C_Read_indv mpiexec one_core
      PASS |      0 | mpich IMB-IO C_Write_expl mpiexec one_core
      PASS |      0 | mpich IMB-IO C_Read_expl mpiexec one_core
      PASS |      0 | mpich IMB-IO C_Write_shared mpiexec one_core
      PASS |      0 | mpich IMB-IO C_Read_shared mpiexec one_core
      PASS |      0 | mpich IMB-EXT Window mpiexec one_core
      PASS |      0 | mpich IMB-EXT Unidir_Put mpiexec one_core
      PASS |      0 | mpich IMB-EXT Unidir_Get mpiexec one_core
      PASS |      0 | mpich IMB-EXT Bidir_Get mpiexec one_core
      PASS |      0 | mpich IMB-EXT Bidir_Put mpiexec one_core
      PASS |      0 | mpich IMB-EXT Accumulate mpiexec one_core
      PASS |      0 | mpich IMB-NBC Ibcast mpiexec one_core
      PASS |      0 | mpich IMB-NBC Iallgather mpiexec one_core
      PASS |      0 | mpich IMB-NBC Iallgatherv mpiexec one_core
      PASS |      0 | mpich IMB-NBC Igather mpiexec one_core
      PASS |      0 | mpich IMB-NBC Igatherv mpiexec one_core
      PASS |      0 | mpich IMB-NBC Iscatter mpiexec one_core
      PASS |      0 | mpich IMB-NBC Iscatterv mpiexec one_core
      PASS |      0 | mpich IMB-NBC Ialltoall mpiexec one_core
      PASS |      0 | mpich IMB-NBC Ialltoallv mpiexec one_core
      PASS |      0 | mpich IMB-NBC Ireduce mpiexec one_core
      PASS |      0 | mpich IMB-NBC Ireduce_scatter mpiexec one_core
      PASS |      0 | mpich IMB-NBC Iallreduce mpiexec one_core
      PASS |      0 | mpich IMB-NBC Ibarrier mpiexec one_core
      PASS |      0 | mpich IMB-RMA Unidir_put mpiexec one_core
      PASS |      0 | mpich IMB-RMA Unidir_get mpiexec one_core
      PASS |      0 | mpich IMB-RMA Bidir_put mpiexec one_core
      PASS |      0 | mpich IMB-RMA Bidir_get mpiexec one_core
      PASS |      0 | mpich IMB-RMA One_put_all mpiexec one_core
      PASS |      0 | mpich IMB-RMA One_get_all mpiexec one_core
      PASS |      0 | mpich IMB-RMA All_put_all mpiexec one_core
      PASS |      0 | mpich IMB-RMA All_get_all mpiexec one_core
      PASS |      0 | mpich IMB-RMA Put_local mpiexec one_core
      PASS |      0 | mpich IMB-RMA Put_all_local mpiexec one_core
      PASS |      0 | mpich IMB-RMA Exchange_put mpiexec one_core
      PASS |      0 | mpich IMB-RMA Exchange_get mpiexec one_core
      PASS |      0 | mpich IMB-RMA Accumulate mpiexec one_core
      PASS |      0 | mpich IMB-RMA Get_accumulate mpiexec one_core
      PASS |      0 | mpich IMB-RMA Fetch_and_op mpiexec one_core
      PASS |      0 | mpich IMB-RMA Compare_and_swap mpiexec one_core
      PASS |      0 | mpich IMB-RMA Get_local mpiexec one_core
      PASS |      0 | mpich IMB-RMA Get_all_local mpiexec one_core
Checking for failures and known issues:
  no test failures

mpi-mpich2 test results on rdma-perf-00/rdma-perf-01 & Beaker job J:8018960:
4.18.0-499.el8.x86_64, rdma-core-44.0-2.el8.1, mlx4, roce.45, ConnectX-3 & mlx4_0
    Result | Status | Test
  ---------+--------+------------------------------------
      PASS |      0 | mpich OSU acc_latency mpiexec one_core
      PASS |      0 | mpich OSU allgather mpiexec one_core
      PASS |      0 | mpich OSU allgatherv mpiexec one_core
      PASS |      0 | mpich OSU allreduce mpiexec one_core
      PASS |      0 | mpich OSU alltoall mpiexec one_core
      PASS |      0 | mpich OSU alltoallv mpiexec one_core
      PASS |      0 | mpich OSU barrier mpiexec one_core
      PASS |      0 | mpich OSU bcast mpiexec one_core
      PASS |      0 | mpich OSU bibw mpiexec one_core
      PASS |      0 | mpich OSU bw mpiexec one_core
      PASS |      0 | mpich OSU cas_latency mpiexec one_core
      PASS |      0 | mpich OSU fop_latency mpiexec one_core
      PASS |      0 | mpich OSU gather mpiexec one_core
      PASS |      0 | mpich OSU gatherv mpiexec one_core
      PASS |      0 | mpich OSU get_acc_latency mpiexec one_core
      PASS |      0 | mpich OSU get_bw mpiexec one_core
      PASS |      0 | mpich OSU get_latency mpiexec one_core
      PASS |      0 | mpich OSU hello mpiexec one_core
      PASS |      0 | mpich OSU iallgather mpiexec one_core
      PASS |      0 | mpich OSU iallgatherv mpiexec one_core
      PASS |      0 | mpich OSU iallreduce mpiexec one_core
      PASS |      0 | mpich OSU ialltoall mpiexec one_core
      PASS |      0 | mpich OSU ialltoallv mpiexec one_core
      PASS |      0 | mpich OSU ialltoallw mpiexec one_core
      PASS |      0 | mpich OSU ibarrier mpiexec one_core
      PASS |      0 | mpich OSU ibcast mpiexec one_core
      PASS |      0 | mpich OSU igather mpiexec one_core
      PASS |      0 | mpich OSU igatherv mpiexec one_core
      PASS |      0 | mpich OSU init mpiexec one_core
      PASS |      0 | mpich OSU ireduce mpiexec one_core
      PASS |      0 | mpich OSU iscatter mpiexec one_core
      PASS |      0 | mpich OSU iscatterv mpiexec one_core
      PASS |      0 | mpich OSU latency mpiexec one_core
      PASS |      0 | mpich OSU latency_mp mpiexec one_core
      PASS |      0 | mpich OSU mbw_mr mpiexec one_core
      PASS |      0 | mpich OSU multi_lat mpiexec one_core
      PASS |      0 | mpich OSU put_bibw mpiexec one_core
      PASS |      0 | mpich OSU put_bw mpiexec one_core
      PASS |      0 | mpich OSU put_latency mpiexec one_core
      PASS |      0 | mpich OSU reduce mpiexec one_core
      PASS |      0 | mpich OSU reduce_scatter mpiexec one_core
      PASS |      0 | mpich OSU scatter mpiexec one_core
      PASS |      0 | mpich OSU scatterv mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 PingPong mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 PingPing mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Sendrecv mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Exchange mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Bcast mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Allgather mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Allgatherv mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Gather mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Gatherv mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Scatter mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Scatterv mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Alltoall mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Alltoallv mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Reduce mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Reduce_scatter mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Allreduce mpiexec one_core
      PASS |      0 | mpich IMB-MPI1 Barrier mpiexec one_core
      PASS |      0 | mpich IMB-IO S_Write_indv mpiexec one_core
      PASS |      0 | mpich IMB-IO S_Read_indv mpiexec one_core
      PASS |      0 | mpich IMB-IO S_Write_expl mpiexec one_core
      PASS |      0 | mpich IMB-IO S_Read_expl mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Write_indv mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Read_indv mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Write_expl mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Read_expl mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Write_shared mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Read_shared mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Write_priv mpiexec one_core
      PASS |      0 | mpich IMB-IO P_Read_priv mpiexec one_core
      PASS |      0 | mpich IMB-IO C_Write_indv mpiexec one_core
      PASS |      0 | mpich IMB-IO C_Read_indv mpiexec one_core
      PASS |      0 | mpich IMB-IO C_Write_expl mpiexec one_core
      PASS |      0 | mpich IMB-IO C_Read_expl mpiexec one_core
      PASS |      0 | mpich IMB-IO C_Write_shared mpiexec one_core
      PASS |      0 | mpich IMB-IO C_Read_shared mpiexec one_core
      PASS |      0 | mpich IMB-EXT Window mpiexec one_core
      PASS |      0 | mpich IMB-EXT Unidir_Put mpiexec one_core
      PASS |      0 | mpich IMB-EXT Unidir_Get mpiexec one_core
      PASS |      0 | mpich IMB-EXT Bidir_Get mpiexec one_core
      PASS |      0 | mpich IMB-EXT Bidir_Put mpiexec one_core
      PASS |      0 | mpich IMB-EXT Accumulate mpiexec one_core
      PASS |      0 | mpich IMB-NBC Ibcast mpiexec one_core
      PASS |      0 | mpich IMB-NBC Iallgather mpiexec one_core
      PASS |      0 | mpich IMB-NBC Iallgatherv mpiexec one_core
      PASS |      0 | mpich IMB-NBC Igather mpiexec one_core
      PASS |      0 | mpich IMB-NBC Igatherv mpiexec one_core
      PASS |      0 | mpich IMB-NBC Iscatter mpiexec one_core
      PASS |      0 | mpich IMB-NBC Iscatterv mpiexec one_core
      PASS |      0 | mpich IMB-NBC Ialltoall mpiexec one_core
      PASS |      0 | mpich IMB-NBC Ialltoallv mpiexec one_core
      PASS |      0 | mpich IMB-NBC Ireduce mpiexec one_core
      PASS |      0 | mpich IMB-NBC Ireduce_scatter mpiexec one_core
      PASS |      0 | mpich IMB-NBC Iallreduce mpiexec one_core
      PASS |      0 | mpich IMB-NBC Ibarrier mpiexec one_core
      PASS |      0 | mpich IMB-RMA Unidir_put mpiexec one_core
      PASS |      0 | mpich IMB-RMA Unidir_get mpiexec one_core
      PASS |      0 | mpich IMB-RMA Bidir_put mpiexec one_core
      PASS |      0 | mpich IMB-RMA Bidir_get mpiexec one_core
      PASS |      0 | mpich IMB-RMA One_put_all mpiexec one_core
      PASS |      0 | mpich IMB-RMA One_get_all mpiexec one_core
      PASS |      0 | mpich IMB-RMA All_put_all mpiexec one_core
      PASS |      0 | mpich IMB-RMA All_get_all mpiexec one_core
      PASS |      0 | mpich IMB-RMA Put_local mpiexec one_core
      PASS |      0 | mpich IMB-RMA Put_all_local mpiexec one_core
      PASS |      0 | mpich IMB-RMA Exchange_put mpiexec one_core
      PASS |      0 | mpich IMB-RMA Exchange_get mpiexec one_core
      PASS |      0 | mpich IMB-RMA Accumulate mpiexec one_core
      PASS |      0 | mpich IMB-RMA Get_accumulate mpiexec one_core
      PASS |      0 | mpich IMB-RMA Fetch_and_op mpiexec one_core
      PASS |      0 | mpich IMB-RMA Compare_and_swap mpiexec one_core
      PASS |      0 | mpich IMB-RMA Get_local mpiexec one_core
      PASS |      0 | mpich IMB-RMA Get_all_local mpiexec one_core
Checking for failures and known issues:
  no test failures