You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Version 1 Next »

Feb. 22, 2017

 

Berkeley:
Great goal x10 reduction
25GB/s is how many images per second? 2kHz for imaging detectors, up to 100kHz at some later date.
Crystallography is going to be hard to do compression. Crystallographers may accept fewer images per second. 2kHz is already enormous improvement.
Diffuse scattering is main science drivers.
Models to predict spots will be hard.
2-fold lossless compression debate at synchrotrons going on.
Reprocess the experiment because it is still research. We don’t agree with each other on what algorithms to use.
Lysozyme gives 2-3um accurate geometry.
In 2025, we may still have 1-50% hit rates.
What percentage of experiments will involve diffuse scattering? Still too early to tell.
Uppsala:
Multievent compression of 3x for any kind of data.
There are data centers interested in data reduction applications. Ian Foster (Argonne), Nick Sauter (Berkeley).
Detector artifacts (such as dynamic changing of gains) may make things difficult.
ADU gradients in cspad was difficult to deal with.
Chunking data would be necessary to achieve MPEG style compression.
Ion Time of Flight may help with hit finding, but liquid jet may have protein in it making ToF signal noisy.
CFEL:
How much money does it cost to saving everything to disk?
Storage costs: $74M out of $150M is about 50% of budget.
Can we allow the user to have all the data for few hours? Reading data from disk will be difficult.
Once data in on disk, people may think they own the data. It will be difficult to delete data at that point.
Identify which fraction of experiment take more disk space. Concentrate on optimizing data hungry experiment.
Multi-crystal images will help reduce number of images and use much fewer x-ray pulses. SFX analysis is improving allowing structure from only 1000 patterns.
CsPad geometry at MFX requires improvement.
Photon conversion is not trivial, but will help compression. A better detector needed.
Many users with some pressure from LCLS may be ready to throw away data on the fly.
Tom would like a week to tweak hit finding to get the most out of data.
Jana:
L3 trigger can be used to test ideas
Spreadsheet of data reduction
Spreadsheet of L3 filter results comparison with ultimate analysis
Talk to Dan Depont about future sample delivery
Talk to Gabriella about detector orientation/calibration
DAQ can not write more than 25GB/s, to expand this will increase cache cost
  • No labels