Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

srun --partition=anagpu --ntasks=4 --ntasks-per-node=4 python ./test_mpi.py

Comparing Different Versions of openmpi on drp-srcf and slac sdf.

We investigate performance of how different builds of openmpi perform on drp-srcf and sdf nodes.

sdf:

1) openmpi 4.0.4 ('--prefix=/opt/openmpi-4.0.4' '--with-ucx' '--enable-mpi-cxx')

drp-srcf:

1) openmpi 4.1.1 (from ana-4.0.23-py3 with ucx)

2) openmpi 4.1.0 (from ps-4.3.2 w/o ucx)

Traffics were going between two nodes. On sdf, these are rome0253-0254 and on srcf eb011-010. Rates (GB/s) shown here are Maximum rate observed.

Send Size (MB)sdf openmpi 4.0.4 w ucx (GB/s)srcf openmpi 4.1.1 w ucx (GB/s)srcf openmpi 4.1.0 w ucx (GB/s)
0.18.241.962.01
16.816.095.85
107.613.173.16
1003.732.382.35
10004.262.231.97