Page History
...
- finds in repository all available status_* files associated with detector/panel and requested run time-stamp,
- merge them by bits, preserve merged file under status_merged type,
- deploy this file in calibration database with type status_extra.
- <PATHREPO> is defined in Path to data and calibration constants for psana in LCLS1
| Code Block | ||
|---|---|---|
| ||
Repository, presumably common for most of detectors. Even can be extended to LCLS-II...: /reg/g/psdm <PATHREPO>/detector/calib/constants/ generic path to files: /reg/g/psdm/<PATHREPO>/detector/calib/constants/<dettype>/<panel-or-detector-id>/<status_type>/<dettype>_<panel-alias>_<YYYYMMDDHHmmSS-of_run>_<expname>_r<runnum>_<status_type>.txt example: /reg/g/psdm<PATHREPO>/detector/calib/constants/epix100a/3925999616-0996579585-0553648138-1232098304-1221641739-2650251521-3976200215/status_user/epix100a_0001_20160318191036_xpptut15_r0260_status_user.txt <PATHREPO>/reg/g/psdm/detector/calib/constants/epix100a/3925999616-0996579585-0553648138-1232098304-1221641739-2650251521-3976200215/status_extra/epix100a_0001_20160318191036_xpptut15_r0260_status_extra.txt merged to: /reg/g/psdm/<PATHREPO>/detector/calib/constants/epix100a/3925999616-0996579585-0553648138-1232098304-1221641739-2650251521-3976200215/status_merged/epix100a_0001_20160318191036_xpptut15_r0260_status_merged.txt deployed to: /cds/data/psdm<PATHREPO>/XPP/xpptut15/calib/Epix100a::CalibV1/XcsEndstation.0:Epix100a.1/status_extra/0-end.data |
...
| Detector | Processing command | Log files directory | Log file name | Code |
|---|---|---|---|---|
| epix10ka | epix10ka_pedestals_calibration | <PATHREPO>/reg/g/psdm/detector/gains/epix10k/panels/logs/<year>/ | <timestamp>_log_epix10ka_pedestals_calibration_<uid>.txt | UtilsEpix10kaCalib.py#L522 |
| jungfrau | jungfrau_dark_proc | /reg/g/psdm/<PATHREPO>/detector/gains/jungfrau/panels/logs/<year>/ | <timestamp>_log_jungfrau_dark_proc_<uid>.txt | UtilsCalib.py#L727 |
| other detectors | calibrun → det_ndarr_dark_proc | <PATHREPO>/reg/g/psdm/logs/calibman/<year>/<month>/ | <time-stamp>-log-<login>-<job-id>.txt | det_ndarr_raw_proc#L337 |
| other detectors | NEW: det_raw_pixel_status deploy_constants | /reg/g/psdm<PATHREPO>/detector/calib/constants/<dettype>/logs/<year>/ <PATHREPO>/reg/g/psdm/detector/calib/constants/<dettype>/logs/<year>/ | <time-stamp>_log_det_raw_pixel_status_<uid>.txt <time-stamp>_log_deploy_constants_<uid>.txt |
Examples
| Code Block | ||||
|---|---|---|---|---|
| ||||
process panel:15 id:0000000002-0173621761-3221225494-1014046789-0019435010-0000000000-0000000000 [I] L0111 evaluate_limits RMS: ave=3.418 std=0.344 limits low=1.353 high=5.483 [I] L0111 evaluate_limits AVE: ave=3155.633 std=147.439 limits low=2271.000 high=4040.267 [I] L0528 Bad pixel status: status 1: 35 pixel rms > 5.483 status 2: 0 pixel rms < 1.353 status 4: 0 pixel intensity > 16000 in more than 0.1 fraction of events status 8: 0 pixel intensity < 1 in more than 0.1 fraction of events status 16: 13 pixel average > 4040.27 status 32: 354 pixel average < 2271 |
| Code Block | ||||
|---|---|---|---|---|
| ||||
raw data found/selected in 999 events [I] L0688 begin data summary stage [I] L0111 evaluate_limits RMS: ave=4.783 std=1.303 limits low=0.001 high=12.604 [I] L0111 evaluate_limits AVE: ave=14191.873 std=457.903 limits low=11444.455 high=16000.000 [I] L0733 bad pixel status: status 1: 244 pixel rms > 12.604 status 2: 550 pixel rms < 0.001 status 4: 418 pixel intensity > 16000 in more than 0.1 fraction of events status 8: 132 pixel intensity < 1 in more than 0.1 fraction of events status 16: 0 pixel average > 16000 status 32: 918 pixel average < 11444.5 [I] L0108 status 64: 139 pixel with bad gain mode switch |
| Code Block | ||||
|---|---|---|---|---|
| ||||
Raw data for XcsEndstation.0:Epix100a.1 found/selected in 1001 events , begin data summary stage evaluate_limits: RMS ave, std = 3.411, 0.276 low, high limits = 1.500, 7.000 evaluate_limits: AVE ave, std = 4515.065, 203.890 low, high limits = 10.000, 10000.000 Bad pixel status: status 1: 134 pixel rms > 7.000 status 8: 5 pixel rms < 1.500 status 2: 6 pixel intensity > 10000 in more than 0.1 fraction of events status 4: 0 pixel intensity < 10 in more than 0.1 fraction of events status 16: 0 pixel average > 10000 status 32: 5 pixel average < 10 |
...
| Detector | Dark processing command | Log file directory | Log file name | Code |
|---|---|---|---|---|
| epix10ka | epix10ka_pedestals_calibration | /cds/group/psdm/<PATHREPO>/detector/gains2/epix10ka/panels/logs/<year>/ | <time-stamp>_log_epix10ka_pedestals_calibration_<uid>txt | UtilsEpix10kaCalib.py#L355 |
| epix100a/opal/etc | det_dark_proc | <PATHREPO>/cds/group/psdm/detector/calib2/epix100/logs/<year>/ | <time-stamp>_log_det_dark_proc_<uid>.txt | UtilsCalib.py#L281 |
Examples
| Code Block | ||||
|---|---|---|---|---|
| ||||
[I] L0230 ________________________________________________________________________________ raw data found/selected in 1000 events [I] L0233 begin data summary stage [I] L0279 bad pixel status: status 1: 300 pixel rms > 6.533 status 2: 1 pixel rms < 0.001 status 4: 1434 pixel intensity > 16000 in more than 0.1 fraction of events status 8: 10170 pixel intensity < 1 in more than 0.1 fraction of events status 16: 31 pixel average > 5280.34 status 32: 2 pixel average < 2692.9 |
| Code Block | ||||
|---|---|---|---|---|
| ||||
[I] L0275 Pre-processing time 16.339 sec
Results for median over pixels intensities:
0.500 fraction of the event spectrum is below 2901.542 ADU - pedestal estimator
0.050 fraction of the event spectrum is below 2896.826 ADU - gate low limit
0.950 fraction of the event spectrum is below 2906.187 ADU - gate upper limit
event spectrum spread median(abs(raw-med)): 1.869 ADU - spectral peak width estimator
[I] L0361 Bad pixel status:
status 1: 6 pixel rms > 3.898
status 2: 0 pixel rms < 0.944
status 4: 0 pixel intensity > 16000 in more than 0.1 fraction of events
status 8: 0 pixel intensity < 1 in more than 0.1 fraction of events
status 16: 2 pixel average > 3821.78
status 32: 0 pixel average < 1986.12 |
...
- Calibration Scripts Repository and Logging
- calibrun - LCLS CLI for dark processing
- Dark processing for LCLS2 area detectors
- Jungfrau and Epix10ka Calibration
- save_constants_in_repository - user's helper to save constants in repository
- det_raw_pixel_status - generates status_data - new algorithms in development
- deploy_constants - deploys constants from repository to DB
- Bad pixel mask - new development
- Paper in JAC: Automatic bad-pixel mask maker for X-ray pixel detectors with application to serial crystallography,
- Journal of Applied Crystallography - 2022 - Sadri - Automatic bad‐pixel mask maker for X‐ray pixel detectors with.pdf
- Bad pixel mask for epix100a xpplw3319
- Path to data and calibration constants for psana in LCLS1
Overview
Content Tools