-
Created by Unknown User (wbfocke), last modified on Oct 19, 2007
You are viewing an old version of this page. View the current version.
Compare with Current
View Page History
« Previous
Version 3
Next »
- xrootd
- requires more bookkeeping because it has no "ls"
- I don't trust it
- Combine steps
- reduces ability to roll back errors
- Varying crumb size
- makes lots of small crumbs, so digi files get read many times
- Varying chunk size
- lots of small chunks mean more jobs are reading in parallel at the start of processing, but it does not increase the amount of data that's read
- Use scratch disks
- need to be able to leave files on scratch for a couple of hours without having a process running
- need to be able to copy files between batch machines with a process only at the receive end of the transfer