- xrootd
- Requires more bookkeeping because it has no "ls".
- I don't trust it - I'm aware that it's not intended to be It's not a drop-in replacement for a disk-based traditional filesystem, and I'm still trying to understand and internalize how it differs from onerequires rethinking assumptions.
- Could stage input or output files in parallel.
- Combine steps
- Reduces ability to roll back errors.
- Increases latency.
- Varying crumb size
- Makes lots of small crumbs, so digi files get read many times.
- Varying chunk size
- Lots of small chunks mean more jobs are reading in parallel at the start of processing, but it does not increase the amount of data that's read.
- If there are more chunks than available cores, that automatically throttles I/O somewhat.
...
{"serverDuration": 43, "requestCorrelationId": "f9db3b1590ddd729"}