Bsub Project
Overview
The bsub project is a simple system to allow jobs to be submitted to batch from Java. The current system is very simple minded, it allows a job to be created anywhere, and submitted via RMI to a server which submits the jobs to LSF. The interface returns the ID of the submitted job, but there is currently no way to access any information about the job after it is submitted, or to be informed when it finishes. Hopefully this system will be replaced by something better soon.
Implmentation.
Getting the code
The package currently lives in the Glast CVS (it should move to the Glast Java CVS soon, and be put under cruise control).
...
Package | Description |
|---|---|
glast.jobcontrol | The implementation of the job submission client, and the server |
glast.jobcontro.demo | A view examples of how to use the client |
Server setup
The server is permanently running on glast02 under user glast. It is installed in ~glast/bsub. It is started by a cron job which runs ~glast/bsub/monitor every 5 minutes, which in turn runs ~glast/bsub/bsub. Note this script starts both the rmiregistry and the JobControlService. The log file is currently written to /tmp/bsub
Care and maintainance
The server has been running for many months with no problems, so no problems are anticipated.
| Info | ||
|---|---|---|
| ||
lsf maintains a log of all submitted jobs in /var/spool/lsf. This is useful for checking exactly what command was executed by the server. |
Installing a new version
If it is necessary to install a new version the procedure is as follows.
...