Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Runs in batch for the dark file to get averaged pedestals.
(tick) ImgAlgos.PrincetonImageProducer gets image from event as an ndarray object
(tick) ImgAlgos.Tahometer evaluates performance of the batch job
(tick) ImgAlgos.ImgAverage produces file with averaged image for given range of events.

For data pre-processing

Scaner
Runs in batch for the data file to get preliminary information.
(tick) ImgAlgos.Tahometer evaluates performance of the batch job, counts number of events in the data file
(tick) ImgAlgos.ImgTimeStampList makes file with time stamps and time record counters for tau
(tick) ImgAlgos.IntensityMonitorsData makes file with intensity monitor records

Average
Runs in batch for the data file to get averaged image
(tick) ImgAlgos.Tahometer evaluates performance of the batch job
(tick) ImgAlgos.PrincetonImageProducer gets image from event as an ndarray object
(tick) ImgAlgos.ImgAverage produces file with averaged image for given range of events
(minus) ImgAlgos::ImgMaskEvaluation - module is available, but needs to be included in psana.cfg file for evaluation of:

  • saturated mask
  • noise mask
  • combined mask

For data processing

Split
(tick) ImgAlgos.Tahometer
(tick) ImgAlgos.PrincetonImageProducer
(tick) ImgAlgos.ImgVsTimeSplitInFiles

Process
Data processing is implemented in stand alone (non-psana) modules
(tick) ImgAlgos.CorAna.cpp
(tick) ImgAlgos.CorAnaInputParameters.cpp
(tick) ImgAlgos.CorAnaData.cpp

Merge
(tick) CorAnaMergeFiles.cpp - saves binary file for float(32) with shape (Ntau,3,rows,cols), where 3 stands for <Ip>, <If>, and <Ip*If>
Can be acessed in python as

...

Infrastructural modules provide basic infrastructure of the project.
(tick)(plus) ConfigParameters.py, ConfigParametersCorAna.py, and GUIConfigParameters.py provides convenient approach for maintenance of all configuration parameters.
(tick) Infrastructural modules Logger.py and GUILogger.py provides a generic approach to logging system.
(tick)(plus) Module ConfigFileGenerator.py use current settings of configuration parameters and stub-file scripts from CorAna/data/scripts/ and generates the psana configuration files.
(tick)(plus) Module FileNameManager.py is a single place which provides a dynamic file names for current version of the configuration parameters.
(tick) GlobalUtils.py - global utilities for common operations
(tick) BatchJob.py - superclass for batch job submission
(tick) BatchJobPedestals.py - pre-processing for dark run files
(tick) BatchJobData.py - re-processing for data files
(tick) BatchJobCorAna.py - main data processing - calculation algorithm.

Global to-do list

Masks
(minus) Evaluation at data pre-processing the noisy and saturated pixel mask
(minus) Graphical editor for regions of interest
(minus) Graphical editor for blemish mask

Processing (at psana Split level?)
(minus) Intensity monitors: needs to be used at processing in psana
(minus) Account for thresholds

View Results
(minus) geometry for reflected beam
(plus) proper combination for total mask in ViewResults.py
(minus) fits

Progress

2012-11-05 – 2012-11-11 Week progress

...

  • GUIViewControl.py
  • GUIViewResults.py
  • ViewResults.py
  • g2 Normalization - need to use parameters from GUISetupInfo etc.
    Map evaluation speed in ViewResults.py for 1300x1340 img
  • x,y maps = 0.02sec
  • r map = 0.05sec
  • theta map = 0.12sec
  • q map = 0.4sec

...

Progress
Work in progress on

  • GUIViewControl.pyViewResults
  • ViewResults.py
  • PlotG2*.py

(tick) Currently available plots for:

  • Raw data maps (tau): <Ip>, <If>, <Ip*If>, g2-raw
  • Geometry maps: X, Y, R, Phi, Q for direct beam mode
  • Partitioning maps: Phi, Q, Q-Phi maps for static and dynamic partitions
  • Masks: Image limits, blemish, hot pixels, good regions, total
  • Calculated maps (tau): total mask as applied at normalization and for maps
    • normalization factors 1/<Ip>, 1/<If> for static bins,
    • g2 as a map
    • g2 averaged over dynamic bins
    • g2 for dynamic bins vs tau as a 2D histogram

(minus) Missing things:

  • g2 vs tau plot for dynamic bins as a set of graphics
  • <q> for dynamic bins
  • hot and saturated pixel mask
  • add geometry maps for reflected beam add selector of the mode in GUI

TO DO

...

  • comment/uncomment submission in ELog
  • add new optional parameter for responce on msg number in submission command when Igor provide an interface; allow to edit field for this parameter in GUIELogPostingDialog
  • change interface for submission command when new release is available (remove long path to the command and PYTHONPATH)

...

    • histogram
    • g2(tau) plot for dynamic bins as a set of graphic

To-do list

Masks
(minus) Evaluation at data pre-processing the noisy and saturated pixel mask
(minus) Graphical editor for regions of interest
(minus) Graphical editor for blemish mask

Processing (at psana Split level?)
(minus) Intensity monitors: needs to be used at processing in psana
(minus) Account for thresholds

View Results
(minus) geometry for reflected beam
(plus) proper combination for total mask in ViewResults.py
(minus) fits

ELog
(plus) Add submission using responce ID, when Igor provide an interface
(plus) GlobalUtils: comment/uncomment submission in ELog

...