Page History

...

SLURM is new job scheduling system for the LCLS batch compute systems it is replacing the current LSF system. Generic documentation about SLURM can be found in this Quick Start User Guide. Even shorter documentation, some of it specific to psana, can be found in this page.

LSF to SLURM Cheat Sheets

Some quick guides showing equivalent commands in LSF and SLURM:

• https://hpc.llnl.gov/banks-jobs/running-jobs/batch-system-commands
• http://ircc.fiu.edu/download/user-guides/Slurm_Cheat_Sheet.pdf
• https://portal.supercomputing.wales/index.php/index/slurm/lsf-to-slurm-ref/

Partitions

The partition/queue information can be provided by the sinfo command.

...

> cat submit.sh
#!/bin/bash

#SBATCH --partition=anagpu
#SBATCH --ntasks=4
#SBATCH --ntasks-per-node=2
#SBATCH --output=%j.log

# -u flushes print statements which can otherwise be hidden if mpi hangs
`whichmpirun mpirun` python -u /reg/g/psdm/tutorials/examplePython/mpiDataSource.py

One can also do this same command from the command line using the "--wrap" option for sbatch:

sbatch -p psfehq -N 2 -n 4 --wrap="mpirun python mpi_simpletest.py"

This script shows some additional features controllable via SLURM:

...