...

ssh -X psana
source /reg/g/psdm/etc/psconda.sh -py3 # Environment to use psana, etc

Working directories

The working directory structure can be confusing, as some of the offline folders are mounted and accessible in the online system. As a rule of thumb, until things are moved away from the online system, one should exclusively work on the ffb.

• The results folder should hosts most of users' code, notebooks, etc. This folder lives on the offline system but is mounted on the ffb: /cds/data/psdm/<hutch>/<experiment>/results/

Access analysis codes and folder from Jupyter lab

In Jupyter hub, you can only navigate within your home folder. It is thus recommended to create shortcuts (soft-links) to the relevant experiment folders, for ease-of-access.

From Jupyter hub, click on the "+" symbol on the top left. Select "terminal" and make a soft-link to the experiment folder:

ln -s /cds/data/psdm/<hutch>/<experiment>/ ./<link>

If the experiment is going to make use of the FFB, make a second soft-link:

ln -s /cds/data/drpsrcf/<hutch>/<experiment>/ ./<link>

Access data

The data will be written to:

When using the FFB processing, data are written to:

/cds/data/drpsrcf/<hutch>/<experiment>/scratch/hdf5/smalldata

and to:

/cds/data/psdm/<hutch>/<experiment>/hdf5/smalldata

for the processing using the 'SLAC' endpoint / the psana system. Data will be moved from the FFB system to this directory within 3-4 weeks after the experiment has ended.

Workflow

The analysis is generally split in two steps, allowing for easy diagnostics and customization of the analysis process. Please contact your controls and data POC to assess the best approach for your experiment.

...

The contents of the smallData files are described here

smallData Contents

Access analysis codes and folder from Jupyter lab

In Jupyter hub, you can only navigate within your home folder. It is thus recommended to create shortcuts (soft-links) to the relevant experiment folders, for ease-of-access.

From Jupyter hub, click on the "+" symbol on the top left. Select "terminal" and make a soft-link to the experiment folder:

ln -s /cds/data/psdm/<hutch>/<experiment>/ ./<link>

If the experiment is going to make use of the FFB, make a second soft-link:

ln -s /cds/data/drpsrcf/<hutch>/<experiment>/ ./<link>

Access data

The data will be written to:

When using the FFB processing, data are written to:

/cds/data/drpsrcf/<hutch>/<experiment>/scratch/hdf5/smalldata

and to:

/cds/data/psdm/<hutch>/<experiment>/hdf5/smalldata

for the processing using the 'SLAC' endpoint / the psana system. Data will be moved from the FFB system to this directory within 3-4 weeks after the experiment has ended.