Confluence will be unusable 23-July-2024 at 06:00 due to a Crowd upgrade.
...
Example slurm batch-job script submitted with "sbatch <scriptname>" ("srun" is the cray-equivalent of "mpirun"). These examples can be found at https://github.com/monarin/psana-nersc.git in "psana1/submit.sh" and "psana1/run_nersc.sh":
Code Block |
---|
#!/bin/bash -l #SBATCH --account=lcls #SBATCH --job-name=lcls-py2-root #SBATCH --nodes=1 #SBATCH --constraint=knl #SBATCH --time=00:15:00 #SBATCH --image=docker:slaclcls/lcls-py2-root:latest #SBATCH --exclusive #SBATCH --qos=regular t_start=`date +%s` export PMI_MMAP_SYNC_WAIT_TIME=600 srun -n 68 -c 4 shifter ./run_nersc.sh t_end=`date +%s` echo PSJobCompleted TotalElapsed $((t_end-t_start)) $t_start $t_end |
...
Code Block |
---|
(login to a cori login node, then execute this command which allocates a node for you to use for 1 hour) salloc -C knl -N 1 -t 1:00:00 -q interactive -A m2859 --image=docker:slaclcls/lcls-py2-root:latest (once that command completes) shifter /bin/bash (get a shell in the shifter image) source /img/conda.local/env.sh (setup conda) source activate psana_base (activate the appropriate conda environment) export SIT_PSDM_DATA=/global/cscratch1/sd/psdatmgr/data/psdm (psana_base) cpo@nid02387:~$ more ~/junk.py from psana import * dsource = MPIDataSource('exp=mfx11116:run=602:dir=/global/cscratch1/sd/psdatmgr/data/psdm/MFX/mfx11116/xtc:smd') det = Detector('Jungfrau1M') for nevt,evt in enumerate(dsource.events()): calib = det.calib(evt) if calib is None: print 'none' else: print calib.shape if nevt>5: break (psana_base) cpo@nid02387:~$ python junk.py (2, 512, 1024) (2, 512, 1024) (2, 512, 1024) (2, 512, 1024) (2, 512, 1024) (2, 512, 1024) (2, 512, 1024) (psana_base) cpo@nid02387:~$ |
...