Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

OpenMPI environment

 We recommend that you compile and run MPI jobs on the bullet cluster using the lsf-openmpi module. It is built from the RedHat OpenMPI source but compiled with support for the LSF batch job system. Login to one of the interactive bullet nodes via "ssh bullet", you will be redirected to either bullet0001 or bullet0002. Once logged in, run which mpirun. The command should return this path: 

/opt/lsf-openmpi/1.58.41/bin//mpirun

You can also check that lsf-openmpi is in use with this command:

renata@bullet0002 $ module list
Currently Loaded Modulefiles:
1) lsf-openmpi_1.5.4-x86_64

...

1.8

...

.

...

.cshrc:             

...

1

...

.bashrc or .bash_profile:

                   bulletcluster=`hostname | grep "^bullet"`
                   if [ "$bulletcluster" != "" ]; then
                   eval `/usr/bin/modulecmd sh unload lsf-openmpi_1.5.4-x86_64`
                   eval `/usr/bin/modulecmd sh load lsf-openmpi_1.8.1-x86_64`
                    fi

If you issue which mpirun after issuing the appropriate modulecmds, you should now see:

...

-x86_64

If you are using lsf-openmpi, Make sure you do not override PATH or LD_LIBRARY_PATH with other OpenMPI directories. An example of a job submission using the lsf-openmpi module: 

bsub -q bulletmpi -n <# cores> -W <runtime_minutes> mpirun <mpi_executable>

...