Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

LCLS is committed to providing its users with their data in a timely and convenient fashion. Experiment data and metadata collected at LCLS may be stored at and retrieved from the facility for a period of ten years. The data retention practices described in this page are on a best effort basis, they depend on availability of the actual resources and may change at any time if these resources become unavailable. Historically we have been able to deliver on these lifetimes (with the exception of scratch where, twice, we had to delete data newer than 4 months), but we cannot guarantee them: available resources depend on the actual usage rate and available funding, which we do not fully control.

Policy by Folder

Space

Quota

Backup

Lifetime

Comment

xtc

None

Tape archive

4 months

Raw data 

usrdaq

None

Tape archive

4 months

Raw data from users' DAQ systems

hdf5

None

Tape archive

4 months

Data translated to HDF5

scratch

None

None

4 months

Temporary data (lifetime not guaranteed)

results

4TB, 10K files

Tape backup

2 years

Analysis results (star)

calibNoneTape backup2 yearsCalibration data

User home

20GB

Disk + tape

Indefinite

User code

Tape archive

-

-

10 years

Raw data (xtc, hdf5, usrdaq)

Tape backup--IndefiniteUser home, results and calib folder
Disk backup--Indefinite

Accessible under ~/.zfs/

(star) For older experiments this folder is called res instead of results

...

  • Please do not store large files under your home, this space is meant for code/scripts, documents, etc, not science data.
  • Users can check the used and available space under their home with a command like:
df -h ~<username>
  • Users can automatically access snapshots of the backup of their home here:
~<username>/.zfs/snapshot/

Cleanup of xtc and hdf5 data
Anchor
purgedata
purgedata

...