Page History
...
| Detector | Processing command | Log files directory | Log file name | Code |
|---|---|---|---|---|
| epix10ka | epix10ka_pedestals_calibration | /reg/g/psdm/detector/gains/epix10k/panels/logs/<year>/ | <timestamp>_log_epix10ka_pedestals_calibration_<uid>.txt | UtilsEpix10kaCalib.py#L522 |
| jungfrau | jungfrau_dark_proc | /reg/g/psdm/detector/gains/jungfrau/panels/logs/<year>/ | <timestamp>_log_jungfrau_dark_proc_<uid>.txt | UtilsCalib.py#L727 |
| other detectors | calibrun → det_ndarr_dark_proc | /reg/g/psdm/logs/calibman/<year>/<month>/ | <time-stamp>-log-<login>-<job-id>.txt | det_ndarr_raw_proc#L337 |
| other detectors | NEW: det_raw_pixel_status deploy_constants | /reg/g/psdm/detector/calib/constants/<dettype>/logs/<year>/ /reg/g/psdm/detector/calib/constants/<dettype>/logs/<year>/ | <time-stamp>_log_det_raw_pixel_status_<uid>.txt <time-stamp>_log_deploy_constants_<uid>.txt |
Examples
| Code Block | ||||
|---|---|---|---|---|
| ||||
process panel:15 id:0000000002-0173621761-3221225494-1014046789-0019435010-0000000000-0000000000 [I] L0111 evaluate_limits RMS: ave=3.418 std=0.344 limits low=1.353 high=5.483 [I] L0111 evaluate_limits AVE: ave=3155.633 std=147.439 limits low=2271.000 high=4040.267 [I] L0528 Bad pixel status: status 1: 35 pixel rms > 5.483 status 2: 0 pixel rms < 1.353 status 4: 0 pixel intensity > 16000 in more than 0.1 fraction of events status 8: 0 pixel intensity < 1 in more than 0.1 fraction of events status 16: 13 pixel average > 4040.27 status 32: 354 pixel average < 2271 |
...
Script det_raw_pixel_status is specifically designed to search for bad pixels in dark and light data using different algorithms, named as "features 1-6" after publication [Journal of Applied Crystallography - 2022 - Sadri]. Algorithms of det_raw_pixel_status in for features 1-6 closely follow to this publication. Feature 11 is a new development to search for bad pixels with too low or too high gain factors.
Meaning and application of features in det_raw_pixel_status can be briefly listed as
| Feature # | Data type | Description | # of events | status type in repository | Comments |
|---|---|---|---|---|---|
| 1 | dark | mean intensity of frames should be in good range | ~1000 | status_dark | |
| 2 | dark | pixel mean intensity should be in good range | ~1000 | status_dark | |
| 3 | dark | pixel rms intensity should be in good range | ~1000 | status_dark | |
| 4 | gain stage indicators between stages | for gain switching detectors only, TBD | |||
| 5 | gain stage indicators for each gain stage | for gain switching detectors only, TBD | |||
| 6 | light | average SNR of pixels over time | ~1000 | status_light | |
| 11 | light | pedestal subtracted pixel intensity max value for entire run should be in good range | entire run sample >10k | status_max | [Bad pixel mask for epix100a xpplw3319] |
where "good range" is equivalent to the "robust statistics" in publication to the bulk of data.
| Code Block | ||||
|---|---|---|---|---|
| ||||
det_raw_pixel_status det_raw_pixel_status -h ... |
LCLS-II
| Detector | Dark processing command | Log file directory | Log file name | Code |
|---|---|---|---|---|
| epix10ka | epix10ka_pedestals_calibration | /cds/group/psdm/detector/gains2/epix10ka/panels/logs/<year>/ | <time-stamp>_log_epix10ka_pedestals_calibration_<uid>txt | UtilsEpix10kaCalib.py#L355 |
| epix100a/opal/etc | det_dark_proc | /cds/group/psdm/detector/calib2/epix100/logs/<year>/ | <time-stamp>_log_det_dark_proc_<uid>.txt | UtilsCalib.py#L281 |
...
- Calibration Scripts Repository and Logging
- calibrun - LCLS CLI for dark processing
- Dark processing for LCLS2 area detectors
- Jungfrau and Epix10ka Calibration
- save_constants_in_repository - user's helper to save constants in repository
- det_raw_pixel_status - generates status_data - new algorithms in development
- deploy_constants - deploys constants from repository to DB
- Bad pixel mask - new development
- Paper in JAC: Automatic bad-pixel mask maker for X-ray pixel detectors with application to serial crystallography,
- Journal of Applied Crystallography - 2022 - Sadri - Automatic bad‐pixel mask maker for X‐ray pixel detectors with.pdf
- Bad pixel mask for epix100a xpplw3319
Overview
Content Tools