Meeting with XPP 2023
Diling, Vincent, Mona, Valerio, Takahiro, Stefano, Cong, Chris
Dec. 7, 2023
Goal: identify:
- precise LCLS1 experiments that can be used to test LCLS-II-HE data reduction algorithms
- identify existing software that does the data analysis
- identify scientist contacts who can approve the results.
Types of XPP-HE experiments in priority order:
- time-resolved diffraction
- signal concentrated in smaller area (like Bragg spots but can be a cluster: spots with satellites. 200x200 or 400x400 pixels, ROI is fixed)
- look at time-evolution
- can be a single pixel as a function of time
- user interested in time-evolution of every pixel in ROI.
- each event has delay time, delay correction, and I0, beam-position, beam-intensity, and other per-shot machine parameters (ebeam and gasdet BLD)
- 400x400 ROI would be 8GB per second.
- readout all detector just so we don't damage the detector, but could throw away data after viewing
- save whole detector at low rate for determining ROI and then only save ROI at high rates
- time-resolved diffuse scattering (evolution of radial integration over time)
- need the whole image
- currently do cube
- risky: time-calibration and filtering, I0 (can be done in many different ways) can be error prone
- currently XPP gets this right "the first time" (after initial setup)
- Diling and Vincent are confident that we can make the cube work "the first time" (after tuning)
- need online visualization (AMI-style)
- can't afford to do angular integration
- Vincent writes about the reason for this: The diffuse scattering signal generally does not have cylindrical symmetry, so azimuthal integration is not appropriate for it
- Diling writes about the reason for this: Right, the pie slice was an example I raised for Tim’s liquid scattering analysis, generally does not apply to material science.
- I0 from wave8 or hsd or another area detector
- DON'T normalize shot-to-shot
- hypercube: image, I0, time-bins, electric-field bins (voltage, e.g. with wave8) and others (aim for 10000 total bins)
- All this happens at 25kHz (not 1MHz)
- risky: time-calibration and filtering, I0 (can be done in many different ways) can be error prone
- another option: angular integration ("pie slices") (wasn't preferred by XPP scientists? Silke is surprised they didn't like this approach, maybe depends on physics?)
- 4Mpx*1000=16GB (float32 data type)
- binning: need the piranha time tool calibrated edge, and need coarse timing per shot: delay-stage encoder
- hope you could use same solution as RIX: interpolated absolute encoder (100Hz) or axilon MHz relative encoder (renishaw?)
- to get error bars may need to store a second cube with image-sum-of-squares for each time-bin (also integrated over shots)
- peakfinding for "speckle visibility spectroscopy"
- "speckles"
- low-intensity XPCS where droplets (synonymous with peak-finding?) are used
- talk to Yanwen/Vincent to get a high-occupancy XPP/XCS dataset (a low-intensity XPCS where droplets are used).
- eventually using sparkpix photon-assignment: either 0 (throw away) or photon locations
- getting I,j,value from sparkpix
- need to tune sparkpix "thresholds" first
- occupancy is 1% or less, implies 2GB/s with 4Mpx 25kHz sparkpix
- can be done with epixUHR or sparkpix, so we need software photon-finding for epixUHR
- photon finding: threshold, find droplet
- need to "count photons" within each peak (which pixels have which photons)
- this could be done as a second step offline?
- could be done as one step in Cong's neural net ("hydranet")
- auto-correlation (XPCS within image)
- save an ROI after an auto-correlation (i.e. calibrated image)
- low priority
- sparse images
- complexity: no single computer sees the whole detector. a big problem
- need to try libSZ or peak finding?
- could do it at high intensity
Meeting with Diling 2021
Nov. 12, 2021 and Nov. 18, 2021
Detectors
Nov. 12, 2021
2 hutch wave8's
1 user wave8
minimum 4 ideally 8 hsd channels 4 cards
can we run 4 channels at 3.2GHz? yes
10kHz full hsd wf's
worried about ringing signal peaks @1MHz (answer: set number of samples)
1 epix10khr 2M
4 or 6 small sparkpix 50um px (thresholding per pixel, 1% occupancy) or few epix10khr
low rate (kHz for small roi) 1Mpixel optical (opal/zyla replacement)
noise performance target: https://axiomoptics.com/low-light-cameras/orca-quest-qcmos-camera/?gclid=CjwKCAiAvriMBhAuEiwA8Cs5lVZr2oRyK4IeQ2DmeYRPhVgmb45QZLiJkxzDK_cBFH9Q5asWHDQ7HBoCo5MQAvD_BwE
piranha camera for timetool, maybe don't need shot to shot? 1kHz? low rate problem for MPI.
Slack question on running hsd's at higher rate than area detectors:
To make sure I’m clear: you might run hsd’s at 1MHz?
Diling Zhu 5:41 PM
if the beam rate is 1MHz, i can definitely think of scenarios, assuminging
area detectors can integrate
Data Reduction
Nov. 18, 2021
hope for pump-probe timing stable so we can average shots in the drp (1000)
expt types:
liquid chemistry
- normalize image using the beamline i0 (wave8, or small epix, or a big epix)
- cube (with binned images or ROI) potentially with 2Mpx by 100 or 200 bins
- bin w.r.t pump-probe from timetool, but could also have 2 laser pumps, and
photon-energy (hypercube)
- optional image processing before binning: pie-slicing (S(q) traces), droplet,
projection to get spectrum
with thresholding (better signal to noise), fit photon positions
- only filter on mono using wave8 and beam position (50% now, less in future)
- no per-shot reading of mono position
- less interested in redundant pie-slicing and cube than tim van driel (more
spectroscopy, less scattering since xpp is monochromatic (lower flux)).
- 5kHz 2026 25kHz 2028
- if time stability is good lose the need for rate: write out summed images at
lower rate: kHz to 10's of hz.
o feedback from timetool could help from that
- if hypercube gets too many bins can make turn it into a 1D image with angular
integrations
emission spectroscopy:
- projection to get spectrum (perhaps not along a line: parabola?)
users need a hook to do other image processing (e.g. for "visible spectroscopy")