...

The FFB system uses SLURM for submitting jobs - information on using SLURM can be found on the Submitting SLURM Batch Jobs page.

Anchor
cleanup cleanup

Directories and Lifetime of data on the FFB

xtc folder

• xtc files are immediately copied to the offline filesystem
• the lifetime on the ffb is dictated by how much data is generated
  • typically files stay on the ffb a week after an experiment ends
  • however if space is need the oldest files will be purged from the FFB even before an experiment has finished
  • after an experiment is done the ffb should not be used anymore except if discussed with the POC

...

1. scratch folder is made non accessible to users.
2. files and directories below the ffb scratch/ are moved to the scratch/ffb/ on the offline filesystem: 
       /cds/data/psdm/<instr>/<expt>/scratch/ffb/ 
   except for hdf5 files in the smalldata folder (see next).
3. hdf5 files below scratch/hdf5/smalldata/  are moved the the hdf5/smalldata/ folder on the offline filesystem, e.g.
   /cds/data/drpsrcf/mfx/mfx123456/scratch/smalldata/*.h5  -> /cds/data/psdm/psdm/mfx/mfx123456/hdf5/smalldata/
   (only .h5 files are moved to the hdf5/smalldata other files will be moved below scratch/ffb/
   Note: Only h5 files (and directories) below scratch/hdf5/smalldata/ are copied to the hdf5/smalldata folder on the offline storage. Files that don't match this rule will be moved to the offline scratch/ffb/hdf5 folder.

FFB File Permissions

The same permission, based on ACLs,  as used for the Lustre analysis file-systems are used for the FFB. However, there is an issue with the current version of the file system:

...