Page History

...

--tiff: in addition to the hdf5 files, each dataset in 2-d shape per event will be also stored as tiff file in the scratch directory. 

Reaching S3DF

To reach s3df, you can access 's3dflogin' via ssh (or from a NoMachine/nx server). To be able to read data/run code, you need to go to the 'psana' machine pool (ssh psana).

To copy data to your home institute, you are use

Working directories

in S3DF, we have a single space for each experiment. The data can be read from two different locations: the ffb and the offline. The data is first available in the ffb and will then move towards the offline. The limited size of the ffb means that data will only be available there temporarily. As rule of thumb, use the offline if data is present there.

The directory structure is as follows:

/sdf/data/lcls/ds/mec/<experiment>/

drwxrws---+ 1 psdatmgr ps-data  0 Mar  3  2022 calib
drwxr-s---+ 1 psdatmgr ps-data  0 Feb 23 14:51 hdf5
drwxrws---+ 1 psdatmgr ps-data  0 Feb 23 15:24 results
lrwxr-x---  1 psdatmgr xs      42 Feb 16 08:07 scratch -> /sdf/scratch/lcls/ds/mec/<experiment>/scratch
drwxrws---+ 1 psdatmgr ps-data  0 Feb 24  2022 stats
drwxr-s---+ 1 psdatmgr ps-data  0 Feb 16 15:23 xtc

The ffb is a mount of the filesystem in the DRPSRCF used already in the previous years:

/sdf/data/lcls/drpsrcf/ffb/mec/<experiment>/

The results folder should hosts most of users' code, notebooks, etc. 

/cds/data/psdm/<hutch>/<experiment>/results/.

...

For more dedicated data processing (covered later), the smalldata_tools working directory generally

...

is

/

...

sdf/data/

...

lcls/ds/<hutch>/<expname>/results/smalldata_tools 

...