Backup of Xrootd FGST data to HPSS

The FGST xrootd cluster is intgrated with HPSS. New files that are copied into the xrootd cluster are marked that they have not been migrated to HPSS. Not all files that are copied to xrootd are backed up but currently only some of the L1 produced files. The list of files that should be migrated to HPSS is produced daily and is used by the migration tools to transfer files to HPSS. Once a file has been migrated to HPSS it is marked as migrated so that it will not be migrated again.

There are three lists of L1 files to backup, found in ~glast/_backupfiles .

The current HPSS tape usage for data backedup from the xrootd cluster to HPSS is:

Show table with sizes of components to backup

What is backed up

The file list level1backup-fullfiles.txt is used but recon files are removed from this list. Therefore the
components

digi filteredMerit ft1 ft2 ft2Seconds gcr ls1 merit recon svac

are backed up.

However there are some recon files in HPSS because a few month ago recon files were backed up.

Tape usage (20090918)

The old HPSS contains about 53K files and 122 TB on 644 tapes.

The new HPSS contains 8TB but these files are also in the old HPSS.