Meeting Notes

Feb 14, 2017

Chuck:

• Tried SPI wavelet compression: 4x (on top of a 4x binned image)
• quantifying the error at goal: 3Angstrom resolution (currently 9nm)

Mikhail:

• looking at igor/matt compression
• much faster than gzip, but limit is 2x compression
• igor used multi-threading, matt did not
• to do: enter igor stuff in spreadsheet, work on argonne package

silke:

• work on pyfai
• ran on  gpu102
• compared with henrik bincount method
• csr ocl is 4x as fast 1x henrik code, their numpy version is very slow (30x slower than henrik's)
• turn it into a metric

clemens:

• benchmarking phi
• python is 8x worse than C
• to do: test at SLAC and test with matrix multiply
• to do: run all corrections and see if we can get 10GB/s

sioan:

• running spatial builds

Feb 7, 2017

sioan:
possible users to contact:

• nora berrah
• dan higley
• mankowsky
• urs staub (elsa abreu)
• marcus kubin (slow andor)
• emmanuel jal
• sam vinko
• christoph bostedt

to do:

• finishing populating list
• will work on algorithms or data transfer
• come up with examples where we need shot-by-shot position measurements with a reticle

silke:
cases where people rerun analysis:

• some people reran roi's 3 months after
• some people had a crappy detector and had to rerun analysis

possible users to contact:

• timbvd
• mike kozina
• reis / mariano
• henrik
• ulvestad
• marco

to do: will work on algorithms or data transfer

mikhail:

• szip (proprietary)
• lzf+shuffle (1.5 for calibrated, 1.7 for raw)
• shuffle (5%-20%)
• best: gzip with shuffle (2.2 for calibrated)
• wait on SZ compressor results
• look at igor algorithm
• picking a feature-extraction

clemens:

• comparing python/C++: still working on it
• zmq/mpi/gasnet
• gasnet: 3 year old python bindings
• setup mtg with elliott/wonchan?
• talk with DAQ about DRP re-configuration

Jan 27, 2017

mikhail:

• henrik algorithm
• filipe maia algorithm
• running on gpus/knl
• evaluate compression package from argonne that amedeo will send out

clemens:

• why only 10GB/s with bincount?
• why c++ 10x faster?
• scaling plot with cores

silke:

• understand required info for each expt (talk to timbvd about real-time angular integration difficulties)

sioan:

• populate amo/sxr 2016 table like Silke

cpo:

• evaluate pyfai
• work on gpu peakfinding with legion with zhenglin
• purchase knl/gpu/nvme boxes