.evt chunk files (~25 per run @ 125MB) are copied from AFS to scratch. Each
twice (digitization and fastmon). All read in paralell.
Fastmon chunk results are moved from scratch to AFS, then from AFS to scratch
for merging. Run-level fastmon file is moved from scratch to NFS, then copied
from NFS to scratch for alarm scanning. These are small.
Digitized chunk files (150MB) are moved from scratch to AFS, then copied from
AFS to scratch for merging (1 copy of each, all read serially), digi and recon
end-of-run and trending (4 copies), svac (1), and recon (usually 6 currently).
That's 11 copies of each all read in parallel, plus 1 copy serial.
Run-level digi file (3.5 GB) is moved from scratch to NFS.
Recon crumb files (~150 @ 125MB recon, 29MB cal, 8MB merit, 0.1MB gcr) are
moved from scratch to AFS, then copied back to scratch for merging into
chunks. Merges of each file type are performed in paralell. Crumbs are
merged into chunks in groups of 6, the files going into a chunk are read
serially. Chunk files (750MB recon, 175MB cal, 50MB merit, .5MB gcr) are
moved from scratch to AFS. After all crumb-to-chunk merges are complete,
crumb files are removed from AFS, they should usually stay on AFS for an hour
or 2.
Recon-output chunk files are copied from AFS to scratch for merging into
run-level files (17GB recon, 4.1GB cal, 1.2GB merit, 12MB gcr). The different
types are merged in parallel, the chunks of each type are read serially.
Run-level files are moved to NFS.
Recon and cal chunks are copied from AFS to scratch for recon end-of-run and
trending (2 copies) and recon only for svac (1). The digi files are copied
for all 3 also, but we already counted those.
Run-level merit file is copied from NFS to scratch for FT1 and FT2
generation. Also run-level digi file for FT2.
Chunk-level monitoring (4 types, all fairly small <~1MB) and svac (190MB)
files are moved from scratch to AFS, then copied to scratch for merging.
Run-level files are moved from scratch to NFS. svac run file is ~4.5GB.
Chunk-level files stay on AFS until the run is completely processed. This is
~2hr in the best case, frequently ~6hr. Worst case is a week.