Backup of Xrootd FGST data to HPSS

The FGST xrootd cluster is integrated with HPSS. New files that are copied into the xrootd cluster are marked that they have not been migrated to HPSS. Not all files that are copied to xrootd are backed up but currently only some of the L1 produced files. The list of files that should be migrated to HPSS is produced daily and is used by the migration tools to transfer files to HPSS. Once a file has been migrated to HPSS it is marked as migrated so that it will not be migrated again.

There are three lists of L1 files to backup, found in ~glast/_backupfiles. Each line of these files contains:

size, checksum, filename

deck.tab.active.border=3px solid blue

The total number of files and accumulated file size in these three lists are:

HPSS Stats

{html-include:url=http://www.slac.stanford.edu/~wilko/glastmon/l1backupbackuplist.html}

What is backed up

The file list level1backup-fullfiles.txt is used but recon files are removed from this list. Therefore the
components

digi filteredMerit ft1 ft2 ft2Seconds gcr ls1 merit recon svac

are backed up.

However there are some recon files in HPSS because a few month ago recon files were backed up.

Tape usage (20090918)

The old HPSS contains about 53K files and 122 TB on 644 tapes.

Currently all files (including recon) from the full-listing are backed up to HPSS.

Show the detail of all the file types, sizes in the three lists

{html-include:url=http://www.slac.stanford.edu/~wilko/glastmon/l1backup.html}

The current HPSS tape usage for data backed up from the xrootd cluster to HPSS is:

{html-include:url=http://www.slac.stanford.edu/~wilko/glastmon/lastffam.html}

...