Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

There are batch farms located in the NEH and FEH. Depending on your data access you may need to submit jobs to a specific farm. This can be accomplished by submitting to the appropriate LSF batch queue. Refer to the table below.

** Please note that the batch queue lclsq has been renamed to psnehq. **psnehq (the old name will remain active for a couple of months).

Multi-core OpenMPI jobs should be run in either the psnehmpiq or psfehmpiq batch queues.(See queue, see the following section on "Running Submitting OpenMPI Job in the PCDS Batch FarmJobs").

Experimental Hall

Queue

Nodes

Data

Comments

NEH

psnehq

psana11xx,psana12xx

ana01, ana02

Jobs <= 6 cores

 

psnehmpiq

psana11xx,psana12xx

ana01, ana02

OpenMPI jobs > 6 cores, preemptable

FEH

psfehq

psana13xx,psana14xx

ana11, ana12

Jobs <= 6 cores

 

psfehmpiq

psana13xx,psana14xx

ana11, ana12

OpenMPI jobs > 6 cores, preemptable

...

http://www.slac.stanford.edu/comp/unix/unix-hpc.html

  • accounts are activated daily at 19:35 (Mon-Thur) or by request to unix-admin@slac.stanford.edu

The batch farm is made of eighty servers with the following general specifications:

  • 12 cores (24 with Hyperthreading), Xeon X5675, 24GB memory, 500GB disk, QDR IB
Submitting

...

Batch Jobs

Login first to to pslogin  (from SLAC) or or to psexport  (from anywhere). From there you can submit a job with the following command:

No Format
bsub -q psnehq -o <output file name> <job_script_command>

For example:

No Format
bsub -q psnehq -o ~/output/job.out my_program

This will submit a job (my_program) to the queue psnehq and write it's psnehq and write its output to a file named ~/output/job.out.

You may check on the status of your jobs using the the bjobs command command.

...

Submitting OpenMPI Batch Jobs

...

The RedHat supplied OpenMPI packages are installed on pslogin, psexport and all of the psana batch servers.

...