Page History

...

• Standard translator:
  
  • directly reads the large xtc files
  • does not start until the xtc files start to appear on the offline file system
  • translation jobs run in the psana queue (fast network link to read)
  • output is to the ana file system (fast network link to write)
  • output is one Hdf5 file per run in the experiments hdf5 folder
  • the hdf5 files are added to the LCLS file manager which means they are archived to tape and can be restored if they were purged from disk.
• Monitoring translator:
  • reads the small xtc files (.smd.xtc) and the large
  • starts as soon as xtc files appear on the fast feedback nodes
  • translation jobs run in the psnehq or psfehq, or priority queues (fast network link to read from ffb)
  • output is to the ana file system (slower network link to write)
  • output is a master file, and one hdf5 file per calib cycle (step)
  • output is written to the experiments scratch folder. It is not backed up and is eligible for purging according to the Data Retention Policy.

The monitoring translator is intended for Multi-calib cycle experiments. It uses MPI to translate different calib cycles in parallel. Typically users will filter the large detectors and write smaller summary information in order to seed up translation for monitoring purposes.

...