Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Beam Test Pipeline Overview

 

The pipeline automatically retrieves all online data produced by LATTE which are currently stored in directories associated with runs numbers and brings them to the SLAC farm. After that, it populates an ORACLE database which provide queries to the data. The pipeline also creates reports, and launches data processing/reconstruction code to produce data files and high level analysis ntuples.
A pipeline diagram can be seen below

...

 Purpose

 Associated Scripts

Input

 Output

Comments

 

 archiveWrapper.pl

 

 

 not used

start ConfigTables task

 ConfTLaunchWrapper.pl

 

 

 

determine whether to digitize run

 decideDigi.pl

 

 

 

make XML file defining task

 genXml.pl

 

 

 currently makes 2 XML files, LICOS version should be removed

start digitization task

 ldfTDLaunchWrapper.pl

 

 

 pipeline side

enter run in eLog

 populateElogDb.pl

 

 

 external side

enter run in eLog

 populateElogDbWrapper.pl

 

 

 pipeline side

 

 retDefTDLaunchWrapper.pl

 

 

 not used by beamtest

Task Name: offLineTest lib

Description: 

 Purpose

 Associated Scripts

Input

 Output

Comments

 

 

 setup.csh

_cleanup0ne.csh

 

 

 not used


  cleanupoRecon.csh

 

 

 

  

  copyWrapper.pl

 

 

 

  

  deleteLinks.csh 

 

 

 currently makes 2 XML files, LICOS version should be removed

 

  deleteWrapper

start ConfigTables task

 test.pl

 

 

 pipeline side

 

Task Name: online

Description: loads the database

  haddMerge.py

 

 

 external side

 

  haddWrapper.pl

 

 

 pipeline side

 

  makeLinks

 Purpose

 Associated Scripts

Input

 Output

Comments

 

 BeamTestLaunch.pl

 

 

 not used by beamtest

 

  queryElogReportTable

start ConfigTables task

 LicosLaunch.pl

 

 

 

 

  TaskLaunch

determine whether to digitize run

 SVACLaunch.pl

 

 

 

 

  tryAFewTimes.csh

 

 

 

 

  updateElogReportTable.pl

 

 

 

 

  updateUrl.py

make XML file defining task

 SVACWrapper.pl

 

 

 currently makes 2 XML files, LICOS version should be removed

 

 

  urlWrapper.pl

 

start digitization task

 getAlgFile.pl

 

   pipeline side

 

Task Name: reconReport offLineTest

Description: lo 

 Purpose

 Associated Scripts

Input

 Output

Comments

 

 genReconTestReport  setup.pl csh

 

 

 

start ConfigTables task

 genReconTestReportWrapper  test.pl  

 

  make XML file defining task

 genXml.pl

 

 

 currently makes 2 XML files, LICOS version should be removed

Task Name: svacTuple online

Description: loads the database

 Purpose

 Associated Scripts

Input

 Output

Comments

 

 archiveWrapper  BeamTestLaunch.pl

 

 

 not used

start ConfigTables task

 ConfTLaunchWrapper  LicosLaunch.pl

 

 

 

determine whether to digitize run

 decideDigi  SVACLaunch.pl

 

 

 

make XML file defining task

 genXml  SVACWrapper.pl

 

 

 currently makes 2 XML files, LICOS version should be removed

start digitization task

 ldfTDLaunchWrapper  getAlgFile.pl

 

 

 pipeline side

enter run in eLog

 populateElogDb.pl

 

 

 external side

enter run in eLog

 populateElogDbWrapper.pl

 

 

...

 pipeline side

 

 

Task Name: lib recon

Description: loads the database 

 Purpose

 Associated Scripts

Input

 Output

Comments

 

 archiveWrapper   cleanup.pl py

 

 

 not used


start ConfigTables task

 ConfTLaunchWrapper   cleanupWrapper.pl

 

 

 

  

  doRecon

determine whether to digitize run

 decideDigi.pl

 

 

 

  

  doReconWrapper

make XML file defining task

 genXml.pl

 

 

 currently makes 2 XML files, LICOS version should be removed

 

 

  genRTRLaunchWrapper

start digitization task

 ldfTDLaunchWrapper.pl

 

 

 pipeline side

 

 

  genXml

enter run in eLog

 populateElogDb.pl

 

 

 external side

enter run in eLog

 

  mergeRecon.py  populateElogDbWrapper.pl

 

 

 pipeline side

 

 retDefTDLaunchWrapper   mergeReconWrapper.pl

 

 

 not used by beamtest

 

  recon.pyl

 

 

 

 

  recon0ne.csh

 

 

 

 

  reconWrapper.pl

 

 

 

 

  reprocess-licos.csh

 

 

 

 

  reprocess-v3r1p5.csh

 

 

 

 

  reprocess-version.csh

 

 

 

 

  RunRALaunchWrapper.pl

 

 

 

 

  setupRecon.py

 

 

 

 

  setupReconWrapper.pl

 

 

 

Task Name: recon reconReport

Description: lo

 Purpose

 Associated Scripts

Input

 Output

Comments

 

 archiveWrapper  genReconTestReport.pl

 

 

 not used  

start ConfigTables task

 ConfTLaunchWrapper.pl

 

 

 

determine whether to digitize run

 decideDigi  genReconTestReportWrapper.pl

 

 

 

make XML file defining task

 genXml.pl

 

 

 currently makes 2 XML files, LICOS version should be removed

start digitization task

 ldfTDLaunchWrapper.pl

 

 

 pipeline side

 

Task Name: setup

Description:

 Purpose

 Associated Scripts

Input

 Output

Comments

 

  dbSetup8.cshrc

enter run in eLog

 populateElogDb.pl

 

 

 external side

enter run in eLog

 

 

  dbSetup10.cshrc

   populateElogDbWrapper.pl

 

 

    pipeline side

   retDefTDLaunchWrappersvacPlSetup.pl cshrc

 

 

   not used by beamtest

 

Task Name: setup svacTuple

Description: loads the database

 Purpose

 Associated Scripts

Input

 Output

Comments

 

 archiveWrapper.pl

 

 

 not used

start ConfigTables task

 ConfTLaunchWrapper  RunRootAnalyzer.pl

 

 

 

determine whether to digitize run

 decideDigi  RunRootAnalyzerWrapper.pl

 

 

 

make XML file defining task

 genXml.pl

 

 

 currently makes 2 XML files, LICOS version should be removed

start digitization task

 ldfTDLaunchWrapper  reprocess-licos-v3r5p5.pl

 

 

 pipeline side

enter run in eLog

 populateElogDb  reprocess-v3r4p6.pl csh

 

 

 external side

enter run in eLog

 populateElogDbWrapper  reprocess.pl csh

 

 

 pipeline side

 

 retDefTDLaunchWrapper.pl

 

 

 not used by beamtest

...