Access to data and SLURM partitions
The FFB system is designed to provide dedicated analysis capabilities during the experiment. After one week from the end of the experiment, the data files will be deleted from FFB and will be available only on one of the offline systems (psana, SDF, or NERSC).
...
- the umask is applied when creating files and directories which violates the ACL specs. As the default umask is 022 the group write permission will be removed. We recommend to set ones umask to:
Lifetime of data on the FFB
Warning |
---|
This section is In progress |
scratch folder
Once an experiment has been complete and all xtc files have been removed the ffb scratch folder is moved to the experiments scratch folder on the ana-filesystems. The following rules are applied:
- scratch folder is made non accessible by the experiment
- hdf5 files below scratch/hdf5/smalldata/ are moved the the hdf5/smalldata/ folder on the ana-filesystems, e.g.
/cds/data/drpsrcf/mfx/mfx123456/scratch/smalldata/*/*hdf5 -> /reg/d/psdm/mfx/mfx123456/hdf5/smalldata - all other files/directories below scratch are moved to /reg/d/psdm/<instr>/<expt>/scratch/ffb/
Access to Lustre ana-filesystems
...