Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Info

Draft, in work. See whiteboard notes.

Some text. Some text. Some text. Some text. Some text. Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.

Use Cases

Some text. Some text. Some text. Some text. Some text. Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat.

  • Provide support for distributed parallel processing by coupling each large raw data file a small metadata "manifest" file containing only offset pointers and filter criteria that allow a parallel processing node to <make XYZ decisions about how to carve up and process the data>

Concepts

Some text. Some text. Some text. Some text. Some text. Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat.

Xtc Detector Data Files

Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.

Gliffy Diagram
size300
nameXtc_per_file_structure

(Note, this is a user-centric description of the data format, focusing on the most typically used parts of the API, and doesn't cover all of the structure and metadata present in the Xtc format. For eample, on disk, Xtc files do not begin with a Names block. For more detail, see Xtc Library Reference)

From a user's standpointFor typical user code, each file effectively begins with a set of data Names,

Xtc Manifest Files

Trying to work up a name for what we labeled "small data" on the whiteboard. "Small data" didn't seem like the right description.

Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.

Redesigning Xtc for LCLS-II

(LCLS-I lessons learned)