- xrootd
- requires more bookkeeping because it has no "ls"
- I don't trust it
- Combine steps
- reduces ability to roll back errors
- Varying crumb size
- makes lots of small crumbs, so digi files get read many times
- Varying chunk size
- lots of small chunks mean more jobs are reading in parallel at the start of processing, but it does not increase the amount of data that's read
- Use scratch disks
- need to be able to leave files on scratch for a couple of hours without having a process running
- need to be able to copy files between batch machines with a process only at the receive end of the transfer
{"serverDuration": 46, "requestCorrelationId": "41e6fff7b0676be7"}