Page History

...

• Intend to use xrootd for storing data files (mainly *.root, *.fits)
  • MC simulations, test data and real data from satellite
  • Some files will be relatively small (10's of MBytes), so
    • Wilko is developing system to tar these files after they are put into xrootd, but before they are put on tape
    )
    • .
• Want xrootd to manage many physical disks
• Want xrootd to manage archiving of files to HPSS (with recovery from tape expected to be rare)
• All files to be put into xrootd should also be registered in data catalog
  • Files are first put into xrootd, then registered in data catalog
    • This is not an atomic transaction
  • Data catalog has "crawler" which verifies existence of files after they have been added
    • Extracts checksum, creation date, # events etc
    • If file exists in multiple locations (e.g. xrootd and NFS) checks consistency of files.

...