Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • The FFB currently offers the fastest file system (WekaIO on NVME disks via IB HDR100) of all LCLS storage systems however it size is only about 400 TB.
  • Typically all xtc The raw data will be kept on the FFB a week after an experiment ends however for data intensive experiments files will might be purged before the week ends maybe even before the an experiment ends.
    Files deleted from the FFB will be available only on one of the offline systems (psana, SDF, or NERSC).
  • The raw data are copied to the offline storage system and to tape immediately, i.e. in quasi real time during the experiment, not after they have been deleted from FFB.
  • The users generated data created in the scratch/ folder are moved to the offline system storage when the experiment is deleted from the FFB described in Lifetime of data on the FFB.
  • For the time being, the new FFB system will be available only for FEH experiments. NEH experiments will still rely on psana resources.

...

  • xtc files are immediately copied to the offline filesystem
  • the lifetime on the ffb is dictated by how much data is generated
    • typically files stay on the ffb during the run-time of a week after an experiment ends
    • however if space is need the oldest files from previous shifts might get purgedwill be purged from the FFB even before an experiment has finished
    • after an experiment is done the ffb should not be used anymore except if discussed with the POC

...