Confluence will be unusable 23-July-2024 at 06:00 due to a Crowd upgrade.
Table of Contents |
---|
Depending on your data access you may need to submit jobs to a specific farm. This is accomplished by submitting to the appropriate LSF batch queue. Refer to the table below for the batch resources available in psana. Jobs for the current experiment should be submitted to the high priority queues psnehhiprioq and psfehhiprioq running against the Fast Feedback storage layer (FFB) located at /reg/d/ffb/<hutch>/<experiment> as shown HERE. Jobs for the off-shift experiment should be submitted to psnehprioq and psfehprioq. Only psneh(hi)prioq/psfeh(hi)prioq should access the FFB. When in doubt, use psanaq.in the Fast Feedback System which allocates resources for the most recent experiments and is significantly faster and more modern than psana.
Submit your job from an interactive node (where you land after doing ssh psana). LSF will run the submitted job on the specified queue using nodes listed in the table below. All nodes in the queues listed below run rhel7RHEL7. By submitting from an interactive node (also running rhel7RHEL7), you will ensure that your job inherits a rhel7 RHEL7 environment.
...
Location
Queue | Nodes |
---|
Data
Comments | Throughput |
---|
[Gbit/s |
---|
] |
---|
Nodes | Cores/Node | RAM |
---|
[GB/node |
---|
Default
Time
Limit
] | Time limit |
---|---|
psanaq | psana11xx, psana12xx,psana13xx, psana14xx |
Primary psana queue | 40 |
80 | 12 | 24 | 48hrs |
psdebugq | same as psanaq |
SHORT DEBUGGING ONLY (preempts psanaq jobs) | 40 |
80 | 12 | 24 | 10min |
psanaidleq | psana11xx, psana12xx,psana13xx, psana14xx |
Jobs preemptable by psanaq | 40 |
80 | 12 | 24 | 48hrs |
NEH
psanamq | psana15xx |
FFB for AMO, SXR, XPP
, psana16xx | Larger memory nodes | 40 |
40 | 16 | 128 | 24hrs |
psnehprioq
psana15xx
FFB for AMO, SXR, XPP
Off-shift NEH experiment on FFB ONLY
psnehq
psana15xx
Jobs preemptable by psneh(hi)prioq
psanagpuq | psanagpu106-psanagpu118 | GPU nodes | 10 | 13 |
16 | 128 |
FEH
psfehhiprioq
psana16xx
FFB for XCS, CXI, MEC
Current FEH experiment on FFB ONLY
24hrs |
psfehprioq
psana16xx
FFB for XCS, CXI, MEC
Off-shift FEH experiment on FFB ONLY
psfehq
psana16xx
Jobs preemptable by psfeh(hi)prioq
Information on submitting jobs to the SLURM system at LCLS can be found on this page: Submitting SLURM Batch Jobs
...