Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

The user community and its sponsoring organizations are very diverse with differing requirements for data retention. The Linac Coherent Light Source (LCLS) cannot guarantee indefinite data archival. Users of LCLS are responsible for meeting the data management requirements of their home institutions and funding agencies. Once data have been provided to the user group, the user group is responsible for managing the long-term retention of their data. 

The data retention practices described in this page are on a best effort basis, they depend on availability of the actual resources and may change at any time if these resources become unavailable. For example, the oldest files on scratch may be deleted at any time to make space for data from new experiments Historically we have been able to deliver on these lifetimes (except for scratch, where we had to delete data newer than 4 months, twice), but we cannot guarantee them: available resources depend on the actual usage rate and available funding, which we don't fully control.

Policy by Folder

Space

Quota

Backup

Lifetime

Comment

xtc

None

Tape archive

4 months

Raw data 

usrdaq

None

Tape archive

4 months

Raw data from users' DAQ systems

hdf5

None

Tape archive

4 months

Data translated to HDF5

scratch

None

None

4 months

Temporary data (lifetime not guaranteed)

results

4TB, 10K files

Tape backup

2 years

Analysis results (star)

calibNoneTape backup2 yearsCalibration data

User home

20GB

Disk + tape

Indefinite

User code

Tape archive

-

-

10 years

Raw data (xtc, hdf5, usrdaq)

Tape backup--IndefiniteUser home, results and calib folder
Disk backup--Indefinite

Accessible under ~/.zfs/

...