Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Warning

So far data are only copied to the S3DF on request and run restores are to the PCDS Lustre file systems.
Contact pcds-datamgt-l@slac.stanford.edu if you would like to access data in the S3DF.

Scratch

A scratch folder is provided for every experiment and is accessible using the canonical path

/sdf/data/lcls/ds/<instr>/<expt>/<expt-folders>/scratch

The scratch folder lives on a dedicated high performance file system and the above path is a link to this file system.

In addition to the experiment scratch folder each users has its own scratch folder:

/sdf/scratch/users/<first character of name>/<user-name>      (e.g. /sdf/scratch/users/w/wilko)

The users scratch space is limited to 100GB and as the experiment scratch folder old files will be automatically removed when the scratch file system is filling up.

Data access example

An example notebook can be found here:
/sdf/home/e/espov/s3df_demo.ipynb

...