...
The FFB system uses SLURM for submitting jobs - information on using SLURM can be found on the Submitting SLURM Batch Jobs page.
Directories and Lifetime of data on the FFBxtc folder
- xtc files are immediately copied to the offline filesystem
- the lifetime on the ffb is dictated by how much data is generated
- typically files stay on the ffb a week after an experiment ends
- however if space is need the oldest files will be purged from the FFB even before an experiment has finished
- after an experiment is done the ffb should not be used anymore except if discussed with the POC
...
- scratch folder is made non accessible to users.
- files and directories below the ffb scratch/ are moved to the scratch/ffb/ on the offline filesystem:
/cds/data/psdm/<instr>/<expt>/scratch/ffb/
except for hdf5 files in the smalldata folder (see next). - hdf5 files below scratch/hdf5/smalldata/ are moved the the hdf5/smalldata/ folder on the offline filesystem, e.g.
/cds/data/drpsrcf/mfx/mfx123456/scratch/smalldata/*.h5 -> /cds/data/psdm/psdm/mfx/mfx123456/hdf5/smalldata/
(only .h5 files are moved to the hdf5/smalldata other files will be moved below scratch/ffb/
Note: Only h5 files (and directories) below scratch/hdf5/smalldata/ are copied to the hdf5/smalldata folder on the offline storage. Files that don't match this rule will be moved to the offline scratch/ffb/hdf5 folder.
FFB File Permissions
The same permission, based on ACLs, as used for the Lustre analysis file-systems are used for the FFB. However, there is an issue with the current version of the file system:
...