Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

Access to data and SLURM partitions

The FFB system is designed to provide dedicated analysis capabilities during the experiment. After one week from the end of the experiment, the data files will be deleted from FFB and will be available only on one of the offline systems (psana, SDF, or NERSC).

...

  • the umask is applied when creating files and directories which violates the  ACL specs. As the default umask is 022 the group write permission will be removed. We recommend to set ones umask to:
Code Block
% umask 0002

Lifetime of data on the FFB

Warning

This section is In progress

scratch folder

Once an experiment has been complete and all xtc files have been removed the ffb scratch folder is moved to the experiments scratch folder on the ana-filesystems. The following rules are applied:

  1. scratch folder is made non accessible by the experiment
  2. hdf5 files below scratch/hdf5/smalldata/  are moved the the hdf5/smalldata/ folder on the ana-filesystems, e.g.
    /cds/data/drpsrcf/mfx/mfx123456/scratch/smalldata/*/*hdf5  -> /reg/d/psdm/mfx/mfx123456/hdf5/smalldata
  3. all other files/directories below scratch are moved to /reg/d/psdm/<instr>/<expt>/scratch/ffb/

Access to Lustre ana-filesystems

...