...
1/11/2012 Under Construction
TASK FUNCTION
Task Overview
top-level stream | sub-stream | type | primary function |
|
|---|---|---|---|---|
setupRun |
| py | discover run number, input files; calculate # parallel substreams |
|
createClumps |
| jy | create substreams |
|
| processClump | py | Gleam reprocessing of run fragment (clump) |
|
| clumpDone | jy | no-op |
|
setupMerge |
| jy | collect data from Pipeline II DB and write to file |
|
mergeClumps |
| py | merge output from processClump; create post-merge data products |
|
runDone |
| jy | register datasets; update processing history DB |
|
Task Details
setupRun.py
- read & parse 'runList' file
- identify run# and input files for this stream
- calculate #clumps (substreams in subtask)
- create env-vars for subtask
...