You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Version 1 Next »

A data catalog has been created to provide a navigable repository for ILC files. The database structure allows for arbitrary metadata to be associated with the files, and includes a download link.

Using the ILC Crawler to Add Files to the Data Catalog

A Java crawler is being developed to automatically add existing STDHEP and SLCIO files to the database, and use the filenames and event headers to collect metadata (e.g. energy, number of events, detector name) which can be stored alongside.

At present, the program simply takes each file supplied to it and generates a shell script of commands using the data catalog API's registerDataset method to add entries to the catalog.

  • No labels