Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
  • xrootd
    • requires more bookkeeping because it has no "ls"
    • I don't trust it - I'm aware that it's not intended to be a drop-in replacement for a disk-based filesystem, and I'm still trying to understand and internalize how it differs from one.
  • Combine steps
    • reduces ability to roll back errors
    • increases latency
  • Varying crumb size
    • makes lots of small crumbs, so digi files get read many times
  • Varying chunk size
    • lots of small chunks mean more jobs are reading in parallel at the start of processing, but it does not increase the amount of data that's read

...