Page History
...
Space | Quota | Backup | Lifetime | Comment |
|---|---|---|---|---|
xtc | None | Tape archive | 4 months | Raw data |
usrdaq | None | Tape archive | 4 months | Raw data from users' DAQ systems |
hdf5 | None | Tape archive | 4 months | Data translated to HDF5 |
scratch | None | None | 4 months | Temporary data (lifetime not guaranteed) |
|
|
|
| |
|
|
|
| |
results | 2TB | Tape backup | 2 years | Analysis results |
User home | 20GB | Disk + tape | Indefinite | User code |
Tape archive | None- | Two copies | 10 years | Raw data (xtc, hdf5, usrdaq) |
| Tape backup | - | Live backup | Indefinite | User home and results folder |
| Disk backup | - | Last 7 days | Indefinite | Accessible under ~/.backup |
Rationale for Proposed Policy
...
- Please do not store under the scratch folder data that you cannot recreate because this directory is not backed up and the oldest files on scratch may be deleted at any time to make space for data from new experiments.
- The backup of the results and home folders is fundamentally different from the archiving of the xtc/hdf5/usrdaq folders. In the latter case tape archive (xtc, hdf5, usrdaq) and the tape backup (results, home) are fundamentally different:
- In the tape archive the folders are frozen after the end of the experiments and their contents are stored on tape once.
- In the
- tape backup, the system takes snapshots of the folders as appear at a given time. this implies that files which are deleted from disk are eventually, i.e. after a long enough time, also deleted from tape.
- For raw data the cleanup operations will affect all files, i.e. all streams and chunks, which make up one run, rather than individual files.
Overview
Content Tools