Page History
...
Space | Size | Backup | Lifetime | Comment |
|---|---|---|---|---|
xtc | Unlimited | Tape archive | 1 year | Raw data |
hdf5 | Unlimited | Tape archive | 1 year | Data translated to HDF5 |
scratch | Unlimited | None | 1 year | Analysis results and temporary data |
User home | Unlimited | Disk + tape | Indefinite | User code |
Tape archive | Unlimited | Two copies | 10 years | Raw data |
...
New Policy
Space | Size | Backup | Lifetime | Storage class | Comment | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
xtc | Unlimited | Tape archive | 3 6 months | Short-term | Raw data | ||||||
hdf5 | Unlimited | Tape archive | 3 6 months | Short-term | Data translated to HDF5 | ||||||
scratch | Unlimited | None | 3 months | Short-term | Temporary data | ||||||
ftc | 10TB | None | 2 years | Medium-term | Filtered, translated, compressed | ||||||
res | 1TB | Disk | 2 years | Medium-term | Analysis results | tmp | Unlimited | None | 3 months | Short-term | Temporary data |
User home | 20GB | Disk + tape | Indefinite |
| User code | ||||||
Tape archive | Unlimited | Two copies | 10 years | Long-term | Raw data |
Note: XTC/HDF5 files can always be restored from tape; files restored from tape will stay on disk for 1 month.
Rationale
The main goal of the new proposed policy based on three different storage classes is twofold:
...
The new policy will be accompanied by web tools to facilitate users in:
- Restoring files from tape to disk
- Move data across Moving runs across the different storage classes
- Applying processing framework to select useful events within a run (only when effective; here we'll need help from users who must decide which events are good)Restoring files from tape to disk
Overview
Content Tools