...

Status of the project

Status of the project on 2012-11-07

Updated on 2013-02-07

PSANA modules

For dark run pre-processing

Scaner

Runs in batch for the dark file to get preliminary information.
ImgAlgos.ImgTimeStampList

• counts number of events in the file
• makes file with time stamps
• evaluate time intervals between frames (for dark run)

Pedestal

Runs in batch for the dark file to get averaged pedestals.
ImgAlgos.PrincetonImageProducer gets image from event as an ndarray object
ImgAlgos.Tahometer evaluates performance of the batch job
ImgAlgos.ImgAverage produces file with averaged image for given range of events.

For data pre-processing

Scaner

Runs in batch for the data file to get preliminary information.
ImgAlgos.Tahometer evaluates performance of the batch job, counts number of events in the data file
ImgAlgos.ImgTimeStampList makes file with time stamps and time record counters for tau
ImgAlgos.IntensityMonitorsData makes file with intensity monitor records

Average

Runs in batch for the data file to get averaged image
ImgAlgos.Tahometer evaluates performance of the batch job
ImgAlgos.PrincetonImageProducer gets image from event as an ndarray object
ImgAlgos.ImgAverage produces file with averaged image for given range of events
ImgAlgos::ImgMaskEvaluation - module is available, but needs to be included in psana.cfg file for evaluation of:

• saturated mask
• noise mask
• combined mask

For data processing

Split

ImgAlgos.Tahometer
ImgAlgos.PrincetonImageProducer
ImgAlgos.ImgVsTimeSplitInFiles

Process

Data processing is implemented in stand alone (non-psana) modules
ImgAlgos.CorAna.cpp
ImgAlgos.CorAnaInputParameters.cpp
ImgAlgos.CorAnaData.cpp

Merge

CorAnaMergeFiles.cpp - saves binary file for float(32) with shape (Ntau,3,rows,cols), where 3 stands for <Ip>, <If>, and <Ip*If>
Can be acessed in python as

    sp.cor_arr = np.fromfile(sp.fname, dtype=np.float32)
    <image-size> = rows * cols
    nptau = <file-size>/<image-size>/3
    sp.cor_arr.shape = (nptau, 3, rows, cols)

GUI

The system of GUIs, consisting of dozens of CorAna.GUI... modules is implemented in the draft approximation. Roughly it reproduces all features of the old program.

Input parameters GUIs

CorAna.GUI... most of them are available. Will be added or extended if necessary.
Files - define input files and do pre-processing
Setup Info
Analysis Info
System
Intensity Monitor needs to be used at processing stage

Run GUI

Input - short summary of input info for data processing
Split - control and monitoring for the 1-st stage of processing
Process - ... 2-nd stage ...
Merge - ... 3-nd stage ...
Auto - ... for all 3 stages ...

View Results GUI

Contains a set of control fields for presentation of results

Graphics

PlotArray*.py - for Intensity Monitors
PlotImgSpe*.py - for images, partition maps, masks etc.
PlotTime*.py - for time stamp monitoring
PlotG2*.py - G2 plot peresentation
Mask editors...

Infrastructural modules

Infrastructural modules provide basic infrastructure of the project.
The system of GUIs, consisting of dozens of CorAna.GUI... modules is implemented in the draft approximation. Roughly it reproduces all features of the old program.
Infrastructural modules ConfigParameters.py, ConfigParametersCorAna.py, and GUIConfigParameters.py provides convenient approach for maintenance of all configuration parameters.
Infrastructural modules Logger.py and GUILogger.py provides a generic approach to logging system.
Module ConfigFileGenerator.py use current settings of configuration parameters and stub-file scripts from CorAna/data/scripts/ and generates the psana configuration files.
Module FileNameManager.py is a single place which provides a dynamic file names for current version of the configuration parameters.
Module BatchJobPedestals.py is intended to prepare, submit, and monitor the butch job for pedestals evaluation.
BatchJobDataPreliminary.py - get the list of PV variables, available intensity moniotors, photon beam intensity etc.
BatchJobFlatField.py - to get the flat field averaged image if relevant run is available.
BatchJobCorAna.py - the batch job for main calculation algorithm.
Graphical presentation for masks, pedestals, averaged image, partitions etc.
Graphical editor for the regions of interest,
Graphical presentation and GUI for final results. GlobalUtils.py - global utilities for common operations
BatchJob.py - superclass for batch job submission
BatchJobPedestals.py - pre-processing for dark run files
BatchJobData.py - re-processing for data files
BatchJobCorAna.py - main data processing - calculation algorithm.

Global to-do list

Masks
Evaluation at data pre-processing the noisy and saturated pixel mask
Graphical editor for regions of interest
Graphical editor for blemish mask

Intensity monitors
needs to be used at processing stage

View Results
geometry for reflected beam
proper combination for total mask in ViewResults.py
fits

Progress

2012-11-05 – 2012-11-11 Week progress

...