Beam Test Pipeline Overview
The pipeline automatically retrieves all online data produced by LATTE which are currently stored in directories associated with runs numbers and brings them to the SLAC farm. After that, it populates an ORACLE database which provide queries to the data. The pipeline also creates reports, and launches data processing/reconstruction code to produce data files and high level analysis ntuples.
A pipeline diagram can be seen below
...
Purpose | Associated Scripts | Input | Output | Comments |
---|---|---|---|---|
| archiveWrapper.pl |
|
| not used |
start ConfigTables task | ConfTLaunchWrapper.pl |
|
|
|
determine whether to digitize run | decideDigi.pl |
|
|
|
make XML file defining task | genXml.pl |
|
| currently makes 2 XML files, LICOS version should be removed |
start digitization task | ldfTDLaunchWrapper.pl |
|
| pipeline side |
enter run in eLog | populateElogDb.pl |
|
| external side |
enter run in eLog | populateElogDbWrapper.pl |
|
| pipeline side |
| retDefTDLaunchWrapper.pl |
|
| not used by beamtest |
Task Name: offLineTest lib
Description:
Purpose | Associated Scripts | Input | Output | Comments | ||
---|---|---|---|---|---|---|
|
| setup.csh | _cleanup0ne.csh |
|
| not used |
cleanupoRecon.csh |
|
|
| |||
| copyWrapper.pl |
|
|
| ||
| deleteLinks.csh |
|
| currently makes 2 XML files, LICOS version should be removed | ||
| deleteWrapper | start ConfigTables task | test.pl |
|
| pipeline side |
|
Task Name: online
Description: loads the database
haddMerge.py |
|
| external side | ||||
| haddWrapper.pl |
|
| pipeline side | |||
| makeLinks | ||||||
Purpose | Associated Scripts | Input | Output | Comments | |||
---|---|---|---|---|---|---|---|
| BeamTestLaunch.pl |
|
| not used by beamtest | |||
| queryElogReportTable | start ConfigTables task | LicosLaunch.pl |
|
|
| |
| TaskLaunch | determine whether to digitize run | SVACLaunch.pl |
|
|
| |
| tryAFewTimes.csh |
|
|
| |||
| updateElogReportTable.pl |
|
|
| |||
| updateUrl.py | make XML file defining task | SVACWrapper.pl |
|
| currently makes 2 XML files, LICOS version should be removed |
|
| urlWrapper.pl |
| start digitization task | getAlgFile.pl |
| pipeline side |
Task Name: reconReport offLineTest
Description: lo
Purpose | Associated Scripts | Input | Output | Comments | |||
---|---|---|---|---|---|---|---|
| genReconTestReport setup.pl csh |
|
|
| |||
start ConfigTables task | genReconTestReportWrapper test.pl |
| make XML file defining task | genXml.pl |
|
| currently makes 2 XML files, LICOS version should be removed |
Task Name: svacTuple online
Description: loads the database
Purpose | Associated Scripts | Input | Output | Comments |
---|---|---|---|---|
| archiveWrapper BeamTestLaunch.pl |
|
| not used |
start ConfigTables task | ConfTLaunchWrapper LicosLaunch.pl |
|
|
|
determine whether to digitize run | decideDigi SVACLaunch.pl |
|
|
|
make XML file defining task | genXml SVACWrapper.pl |
|
| currently makes 2 XML files, LICOS version should be removed |
start digitization task | ldfTDLaunchWrapper getAlgFile.pl |
|
| pipeline side |
enter run in eLog | populateElogDb.pl |
|
| external side | enter run in eLog | populateElogDbWrapper.pl |
|
...
pipeline side
Task Name: lib recon
Description: loads the database
Purpose | Associated Scripts | Input | Output | Comments | |||
---|---|---|---|---|---|---|---|
| archiveWrapper cleanup.pl py |
|
| not used | |||
start ConfigTables task | ConfTLaunchWrapper cleanupWrapper.pl |
|
|
| |||
| doRecon | determine whether to digitize run | decideDigi.pl |
|
|
| |
| doReconWrapper | make XML file defining task | genXml.pl |
|
| currently makes 2 XML files, LICOS version should be removed | |
| genRTRLaunchWrapper | start digitization task | ldfTDLaunchWrapper.pl |
|
| pipeline side | |
| genXml | enter run in eLog | populateElogDb.pl |
|
| external side | enter run in eLog |
| mergeRecon.py populateElogDbWrapper.pl |
|
| pipeline side | |||
| retDefTDLaunchWrapper mergeReconWrapper.pl |
|
| not used by beamtest | |||
| recon.pyl |
|
|
| |||
| recon0ne.csh |
|
|
| |||
| reconWrapper.pl |
|
|
| |||
| reprocess-licos.csh |
|
|
| |||
| reprocess-v3r1p5.csh |
|
|
| |||
| reprocess-version.csh |
|
|
| |||
| RunRALaunchWrapper.pl |
|
|
| |||
| setupRecon.py |
|
|
| |||
| setupReconWrapper.pl |
|
|
|
Task Name: recon reconReport
Description: lo
Purpose | Associated Scripts | Input | Output | Comments | |||||
---|---|---|---|---|---|---|---|---|---|
| archiveWrapper genReconTestReport.pl |
|
| not used | |||||
start ConfigTables task | ConfTLaunchWrapper.pl |
|
|
| determine whether to digitize run | decideDigi genReconTestReportWrapper.pl |
|
|
|
make XML file defining task | genXml.pl |
|
| currently makes 2 XML files, LICOS version should be removed | |||||
start digitization task | ldfTDLaunchWrapper.pl |
|
| pipeline side |
Task Name: setup
Description:
Purpose | Associated Scripts | Input | Output | Comments | ||||
---|---|---|---|---|---|---|---|---|
| dbSetup8.cshrc | enter run in eLog | populateElogDb.pl |
|
| external side | enter run in eLog |
|
| dbSetup10.cshrc | populateElogDbWrapper.pl |
|
| ||||
pipeline side | retDefTDLaunchWrappersvacPlSetup.pl cshrc |
|
| not used by beamtest |
Task Name: setup svacTuple
Description: loads the database
Purpose | Associated Scripts | Input | Output | Comments |
---|---|---|---|---|
| archiveWrapper.pl |
|
| not used |
start ConfigTables task | ConfTLaunchWrapper RunRootAnalyzer.pl |
|
|
|
determine whether to digitize run | decideDigi RunRootAnalyzerWrapper.pl |
|
|
|
make XML file defining task | genXml.pl |
|
| currently makes 2 XML files, LICOS version should be removed |
start digitization task | ldfTDLaunchWrapper reprocess-licos-v3r5p5.pl |
|
| pipeline side |
enter run in eLog | populateElogDb reprocess-v3r4p6.pl csh |
|
| external side |
enter run in eLog | populateElogDbWrapper reprocess.pl csh |
|
| pipeline side |
| retDefTDLaunchWrapper.pl |
|
| not used by beamtest |
...