Batch Nodes/Queues
Depending on your data access you may need to submit jobs to a specific farm. This is accomplished by submitting to the appropriate LSF batch queue. Refer to the table below. Jobs for the current experiment should be submitted to the high priority queues psnehhiprioq and psfehhiprioq running against the Fast Feedback storage layer (FFB) located at /reg/d/ffb/<hutch>/<experiment> as shown HERE. Jobs for the off-shift experiment should be submitted to psnehprioq and psfehprioq. Only psneh(hi)prioq/psfeh(hi)prioq should access the FFB. When in doubt, use psanaq.
Submit your job from an interactive node (where you land after doing ssh psana). LSF will run the submitted job on the specified queue using nodes listed in the table below. All nodes in the queues listed below run rhel7. By submitting from an interactive node (also running rhel7), you will ensure that your job inherits a rhel7 environment.
Location | Queue | Nodes | Data | Comments | Throughput | Cores | Cores/Node | RAM (GB/node) | Default |
|---|---|---|---|---|---|---|---|---|---|
| Building 50 | psanaq | psana11xx, psana12xx,psana13xx, psana14xx | ALL (no FFB) | Primary psana queue | 40 | 960 | 12 | 24 | 48hrs |
| psdebugq | same as psanaq | same as psanaq | SHORT DEBUGGING ONLY (preempts psanaq jobs) | 40 | 24 | 12 | 24 | 10min | |
| psanaidleq | psana11xx, psana12xx,psana13xx, psana14xx | Jobs preemptable by psanaq | 40 | 960 | 12 | 24 | 48hrs | ||
NEH | psnehhiprioq | psana15xx | FFB for AMO, SXR, XPP | Current NEH experiment on FFB ONLY | 40 | 288 | 16 | 128 | 24hrs |
psnehprioq | psana15xx | FFB for AMO, SXR, XPP | Off-shift NEH experiment on FFB ONLY | 40 | 288 | 16 | 128 | 24hrs | |
| psnehq | psana15xx |
| Jobs preemptable by psneh(hi)prioq | 10 | 288 | 16 | 128 | 48hrs |
FEH | psfehhiprioq | psana16xx | FFB for XCS, CXI, MEC | Current FEH experiment on FFB ONLY | 40 | 288 | 16 | 128 | 24hrs |
psfehprioq | psana16xx | FFB for XCS, CXI, MEC | Off-shift FEH experiment on FFB ONLY | 40 | 288 | 16 | 128 | 24hrs | |
| psfehq | psana16xx |
| Jobs preemptable by psfeh(hi)prioq | 10 | 288 | 16 | 128 | 48hrs |
Submitting Jobs
Information on submitting jobs to the SLURM system at LCLS can be found on this page: Submitting SLURM Batch Jobs
Information on the submitting jobs to the (deprecated) LSF batch system can be found on this page: (Deprecated) Submitting LSF Batch Jobs
Information on the Automatic Run Processing system (ARP) can be found on this page: Automatic Run Processing
Overview
Content Tools