You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 2 Next »

  • xrootd
    • requires more bookkeeping because it has no "ls"
    • I don't trust it
  • Combine steps
    • reduces ability to roll back errors
  • Varying crumb size
    • makes lots of small crumbs, so digi files get read many times
  • Varying chunk size
    • lots of small chunks mean more jobs are reading in parallel at the start of processing, but it does not increase the amount of data that's read
  • No labels