...
Pipeline Tasks and Associated Scripts
Each pipeline tasks task consists of several c-shell, python and perl scripts.
Pipeline tasks are structured as a linear chain of steps. Each step must succeed before going on to the next one. Each step must be attempted, until one fails or the last one succeeds. That is to say, there is no flow control, and no parallelism. In order to deal with this, and to reduce the chance that a step would not be reached due to the failure of a previous step on which it did not logically depend, the work we do in the pipeline is split into 7 tasks, all but one of which (updateELogDB) are launched internally.
Most steps within a task (Task Processes (TPs)) consist of a wrapper, which interfaces with the pipeline infrastructure (GINO) and a script which does the work, usually by running some external app.
...