You are viewing an old version of this page. View the current version.
Compare with Current
View Page History
« Previous
Version 7
Next »
Currently this is only possible for "early access users" who have accounts at NERSC.
- data are available at NERSC in this directory (the equivalent of /reg/d/psdm): /global/project/projectdirs/lcls/d/psdm/. Set environment variable SIT_PSDM_DATA to this location so psana will be able to locate the data
- ssh to cori.nersc.gov (the equivalent of a pslogin node)
- information on the cori batch system ("slurm") is here
- there are 32 cores on each cori node
- to get to the equivalent of a "psana" node you should run an "interactive job" as described here
Example slurm script submitted with "sbatch <scriptname>" ("srun" is the cray-equivalent of "mpirun"):
#!/bin/bash
#SBATCH -p regular
#SBATCH -N 1
#SBATCH -t 01:00:00
#SBATCH -A lcls
#SBATCH --image=docker:registry.services.nersc.gov/psana:ana-0.17.4a
module load shifter
cd $HOME/shifter
srun -n 32 shifter ./myjob.csh
Where my job.csh looks like the usual psana-python command:
#!/bin/tcsh
source /reg/g/psdm/etc/ana_env.csh
cd $HOME/shifter
setenv SIT_PSDM_DATA /global/project/projectdirs/lcls/g/psdm/
python psana_io_benchmark.py exp=cxig3614:run=81
Getting An Account
Note: this should only be necessary for expert developers. Send mail to pcds-ana-l if you have questions.
Apply for an account at this link:
http://www.nersc.gov/users/accounts/user-accounts/get-a-nersc-account/
Use "Amedeo Perazzo" as the PI, and "LCLS" as the repo.
Useful NERSC Links
(courtesy of Anton Barty)
• The ‘module add’ command. Explains why stuff is not there by default, and how to get it easily.
If you don’t find this, you’re lost (or end up reinstalling pointlessly)
• Version control
• Libraries
• Globus for data transfer
• Queues
X11 can be slow from afar. I did find NX instructions with a nice tutorial
You seem to need the tutorial to get it to work