It may be advantageous or necessary to do data analysis without a connection to SLAC. Below are the steps to install psana along with the data to be used in the analysis onto a local machine for later, offline use on a RHEL 5, 6 or 7 machine. In the simplest case, a single conda environment is maintained but multiple conda environments can be created and used if necessary. The steps for both cases are shown below.
Installation of a Single Conda Environment
- Go to https://conda.io/miniconda/
- Install the Python 2.7 64 bit bash installer (unless your OS is 32 bit but it most likely will not be)
- Find the installed file Miniconda3-latest-Linux-x86_64.sh
- It will probably be in Downloads, so do cd Downloads
- Run it with bash Miniconda3-latest-Linux-x86_64.sh
- Add miniconda2 to PATH
- The installation will automatically add the path to the .bashrc file
- Close and reopen terminal and check by typing conda list which will print out the installed packages
- If conda is not found, follow step 5, else skip to step 6
- If not already created, create a .bash_profile file in your home directory
Add the following script to it. This checks for the .bashrc and will run it on start up
if [ -f $HOME/.bashrc ]; then source $HOME/.bashrc fi
Run conda update -y conda to update miniconda
Install Psana Conda with conda install -y --channel lcls-rhel<num> psana-conda where <num> is the the RHEL version
Copy the experiment database from /reg/g/psdm/data/ExpNameDb/experiment-db.dat
Make a directory in the home directory with mkdir -p data/ExpNameDb
Copy the database
With rsync: rsync -t psexport:/reg/gpsdm/data/ExpNameDb/experiment-db.dat ~/data/ExpNameDb/
With SCP: scp -p psexport:/reg/g/psdm/data/ExpNameDb/experiment-db.dat ~dataExpNameDb/
Copy the experiment data that will be used for analysis. This step requires patience if many runs will be copied
- For example, downloading run 54 from the experiment xpptut15, the following files were copied:
From /reg/d/psdm/xpp/xpptut15/xtc:
-bash-4.2$ ls /reg/d/psdm/xpp/xpptut15/xtc/ | grep 54 e665-r0054-s00-c00.xtc e665-r0054-s01-c00.xtc e665-r0054-s02-c00.xtc e665-r0054-s03-c00.xtc e665-r0054-s04-c00.xtc e665-r0054-s05-c00.xtc
From /reg/d/psdm/xpp/xpptut15/xtc/index:
-bash-4.2$ ls /reg/d/psdm/xpp/xpptut15/xtc/index | grep 54 e665-r0054-s00-c00.xtc.idx e665-r0054-s01-c00.xtc.idx e665-r0054-s02-c00.xtc.idx e665-r0054-s03-c00.xtc.idx e665-r0054-s04-c00.xtc.idx e665-r0054-s05-c00.xtc.idx
From /reg/d/psdm/xpp/xpptut15/xtc/smalldata:
-bash-4.2$ ls /reg/d/psdm/xpp/xpptut15/xtc/smalldata | grep 54 e665-r0054-s00-c00.smd.xtc e665-r0054-s01-c00.smd.xtc e665-r0054-s02-c00.smd.xtc e665-r0054-s03-c00.smd.xtc e665-r0054-s04-c00.smd.xtc e665-r0054-s05-c00.smd.xtc
- And the entire directory /reg/d/psdm/xpp/xpptut15/calib
- Copy using either rsync or SCP. SCP may be simpler in this case because it copies the data of a symbolic link which is what is desired.
- For example, downloading run 54 from the experiment xpptut15, the following files were copied: