Page History
...
1. Node configurations
To achieve a MHz rate, we need to consider the following:
- The heavy-lifting SMD0 core
...
- (MPI rank 0) needs to be assigned on an individual node exclusively. This will allow the entire node to read smalldata in parallel at the full bandwidth.
- The Srv cores (data writing) should not exceed some limit (currently, we see 8 as the upper limit for data writing cores).
To assign node configurations To assign a specific node to SMD0, run
Code Block |
---|
#!/bin/bash #SBATCH --partition=anagpu #SBATCH --nodes=2 #SBATCH --ntasks-per-node=3 #SBATCH --output=%j.log # setup node configurations ./setup_nodes.sh # "-u" flushes print statements which can otherwise be hidden if mpi hangs # "-m mpi4py.run" allows mpi to exit if one rank has an exception mpirun python -u -m mpi4py.run /reg/g/psdm/tutorials/examplePython/mpiDataSource.py |
...
Overview
Content Tools