Page History

...

Note: XTC/HDF5 files can always be restored from tape; files restored from tape will stay on disk for 1 month.

Rationale

The goal of the new proposed policy based on three different storage classes is twofold:

• Allow users to have easy access (ie on disk) to the most frequently used data for a longer period of timeEncourage users to filter their data to get rid of useless runs or useless events within a run

• Make better use of the LCLS storage resources

Tools

The new policy will be accompanied by web tools to facilitate users in:

...

You may, but try to be a good citizen by selecting only the most frequently used files and by restoring from tape what you rarely use.

...

Starting November 1st 2012, all files under scratch which are older than 6 months will be deleted. Use the ftc or res directories to extend the lifetime of your intermediate data.

Can we restore raw files from tape to disk by ourselves?

Yes, use you can restore raw files (xtc and hdf5) from tape using the file manager tab in the experiment web portal.

Can we restore the contents of the ftc, res and scratch folders from tape?

No, the contents of the ftc and scratch directories are not backed up or archived. The contents of the res folder, though, can be restored on demand from a disk backup.

How long does it take to restore files from tape to disk?

...

The scratch directory is meant to provide a large, short term disk storage (6-months) for intermediate results. Users can write to this directory during data analysis development and later on move the most important results to res. This Please do not store under scratch data that you cannot recreate because this directory is not backed up and it . This folder doesn't have a quota.

Can we ask for an increase of the 2-years quota for a particular experiment?

...