Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Single slot jobs are not allowed in these queues.  There is also a limit on the total number of cores in use by the bulletmpi and bulletmpi-large queues.  You can see what that limit is by running the command blimits which shows  that there are 3072 slots total available to those 2 queues and at the moment of the command they are all in use:

renata@victoria $ 13:41 blimits -w

...

NAME                         USERS       QUEUES                          HOSTS         PROJECTS      SLOTS           MEM TMP SWP JOBS 
bulletmpi_total_limit            -          bulletmpibulletmpi bulletmpi-large bulletfarm/      -       3072/3072       - -   -   -
bulletmpi_slot_limit         hezaveh    bulletmpi                           -              -         288/512        -  -   -    -
bulletmpi_slot_limit         lehmann     bulletmpi                        -              -         128/512        - - - -
bulletmpi_slot_limit         sforeman    bulletmpi                        -              -         256/512        - - - -
bulletmpi_slot_limit         frubio      bulletmpi                       -              -          32/512        - - - -
bulletmpi_slot_limit         weast       bulletmpi                        -              -         300/512        - - - -
bulletmpi_slot_limit         cuoco       bulletmpi                       -              -          20/512        - - - -
bulletmpi_long_slot_limit shoeche    bulletmpi-large                  -             -       2048/2048      - - - -

...


There are 2 flavors of mpi available at SLAC, the stock RedHat rpm version, and the RedHat version compiled with LSF hooks.   They each use a slightly different bsub command to submit jobs.

...