Batch Jobs

One Time Setup

If you don't have a SLAC system ID (i.e. you are not in the SLAC Directory) apply for one electronically here.

After you have a SLAC system ID, if you don't have a SLAC account fill out the (unfortunately) non-electronic forms here and return them to the mighty administrator.

Email the administrator requesting access to the queues, along with your SLAC account name. It might take a couple of hours to add you to the appropriate permissions lists.

Add the following line to your .cshrc file:

setenv PATH /usr/local/bin:${PATH}:/afs/slac/g/suncat/bin

If you have a line like the following in .cshrc remove it:

eval `/usr/local/bin/environ /bin/tcsh -i${?prompt} -e emacs:vi`

Queues

Submitting Jobs

It is important to have an "afs token" before submitting jobs. Check the status with the tokens commands. Renew every 24 hours with /usr/local/bin/kinit command.

Login to any suncat machine (e.g. suncat0001) to execute commands like these:

gpaw-bsub -o mo2n.log -q <qname> -n 8 gpaw-python mo2n.py 
dacapo-bsub -o Al-fcc-single.log -q <qname> -n 8 Al-fcc-single.py
jacapo-bsub -o Al-fcc-single.log -q <qname> -n 8 co.py

NOTE: Because of a file-locking bug in afs, all output from GPAW should go to nfs. Our fileserver space is at /nfs/slac/g/suncatfs.

ANOTHER NOTE: The above commands "take control" and set all the environment, preventing the user from changing part of the environment (PATH, PYTHONPATH, etc.). If you want to take that fancier (but more error prone) approach, look at the 2 lines in the gpaw-bsub/dacapo-bsub scripts in /afs/slac/g/suncat/bin, and modify the environment after executing the "setupenv" command, and before executing the "bsub" command.

Useful Commands

Login to any suncat machine (e.g. suncat0001) to execute these.

bjobs (shows your current list of batch jobs and jobIds)
bjobs -u all | grep suncat (show jobs of all users in the suncat queues)
bpeek <jobId> (examine logfile output from job that may not have been flushed to disk)
bkill <jobId> (kill job)
bmod <various parameters> (modify job parameters, e.g. position in queue)
lsload -R suncat (show CPU loading of all suncat machines)
lshosts -R suncat (show list of suncat machines and associated info)
bhosts -w suncatfarm (show status of hosts, from a batch perspective)