Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

svac pipeline code and tasks:

code/tasks v3r5p9:v3r6p0:

Make LicosLaunch die if run directory isn't in rawData.

More & better timestamps in recon chunk script.

Put output from each chunk in a separate subdir of staging dir.

Merge chunks into staging dir, then move merged files to destination.

Merge recon chunks before merit & cal.

Use new AFS staging dir.

Switch rootData to u34.

Split recon/recon into 6 processes to get better rollback granularity.

When recon of some chunks fail, save the output from the successful ones and don't re-run them.

# Don't do merge on single-chunk recon runs. # Disabled! - do do merge.

All file copies & moves performed by recon are attempted up to 5 times, then fail (used to try until the job timed out on copies to local disk, and only once for moves away from local disk or staging).

pipelineDatasets v0r3

ISOC code and tasks:

...