Dark data processing algorithms include pixel status evaluation which is saved in calibration files of type pixel_status. This note explains how to find definition and statistics of the bad pixel bits.
The best source of information about bad pixel content and statistics is the log file. Another option is to look at code. Tables in this note contain references to both sources of information for different type of commands/detectors.
LCLS
Detector | Dark processing command | Log files directory | Log file name | Code |
---|
epix10ka | epix10ka_pedestals_calibration | /reg/g/psdm/detector/gains/epix10k/panels/logs/<year>/ | <timestamp>_log_epix10ka_pedestals_calibration_<uid>.txt |
|
jungfrau | jungfrau_dark_proc | /reg/g/psdm/detector/gains/jungfrau/panels/logs/<year>/ | <timestamp>_log_jungfrau_dark_proc_<uid>.txt |
|
other detectors | calibrun | /reg/g/psdm/logs/calibman/<year>/<month>/ | <time-stamp>-log-<login>-<job-id>.txt |
|
Examples
Code Block |
---|
title | /reg/g/psdm/detector/gains/epix10k/panels/logs/2022/2022-07-05T142149_log_epix10ka_pedestals_calibration_jortiz.txt |
---|
collapse | true |
---|
|
process panel:15 id:0000000002-0173621761-3221225494-1014046789-0019435010-0000000000-0000000000
[I] L0111 evaluate_limits RMS: ave=3.418 std=0.344 limits low=1.353 high=5.483
[I] L0111 evaluate_limits AVE: ave=3155.633 std=147.439 limits low=2271.000 high=4040.267
[I] L0528 Bad pixel status:
status 1: 35 pixel rms > 5.483
status 2: 0 pixel rms < 1.353
status 4: 0 pixel intensity > 16000 in more than 0.1 fraction of events
status 8: 0 pixel intensity < 1 in more than 0.1 fraction of events
status 16: 13 pixel average > 4040.27
status 32: 354 pixel average < 2271 |
Code Block |
---|
title | /reg/g/psdm/detector/gains/jungfrau/panels/logs/2022/2022-07-02T074644_log_jungfrau_dark_proc_yanwen.txt |
---|
collapse | true |
---|
|
raw data found/selected in 999 events
[I] L0688 begin data summary stage
[I] L0111 evaluate_limits RMS: ave=4.783 std=1.303 limits low=0.001 high=12.604
[I] L0111 evaluate_limits AVE: ave=14191.873 std=457.903 limits low=11444.455 high=16000.000
[I] L0733 bad pixel status:
status 1: 244 pixel rms > 12.604
status 2: 550 pixel rms < 0.001
status 4: 418 pixel intensity > 16000 in more than 0.1 fraction of events
status 8: 132 pixel intensity < 1 in more than 0.1 fraction of events
status 16: 0 pixel average > 16000
status 32: 918 pixel average < 11444.5
[I] L0108
status 64: 139 pixel with bad gain mode switch |
Code Block |
---|
title | /reg/g/psdm/logs/calibman/2022/07/2022-07-05-14:24:06-log-jortiz-131554.txt |
---|
collapse | true |
---|
|
Raw data for XcsEndstation.0:Epix100a.1 found/selected in 1001 events , begin data summary stage
evaluate_limits: RMS ave, std = 3.411, 0.276 low, high limits = 1.500, 7.000
evaluate_limits: AVE ave, std = 4515.065, 203.890 low, high limits = 10.000, 10000.000
Bad pixel status:
status 1: 134 pixel rms > 7.000
status 8: 5 pixel rms < 1.500
status 2: 6 pixel intensity > 10000 in more than 0.1 fraction of events
status 4: 0 pixel intensity < 10 in more than 0.1 fraction of events
status 16: 0 pixel average > 10000
status 32: 5 pixel average < 10 |
LCLS-II
Detector | Dark processing command | Log file directory | Log file name | Code |
---|
epix10ka | epix10ka_pedestals_calibration | /cds/group/psdm/detector/gains2/epix10ka/panels/logs/<year>/ | <time-stamp>_log_epix10ka_pedestals_calibration_<uid>txt | UtilsEpix10kaCalib.py#L355 |
epix100a/opal/etc | det_dark_proc | /cds/group/psdm/detector/calib2/epix100/logs/<year>/ | <time-stamp>_log_det_dark_proc_<uid>.txt | UtilsCalib.py#L281 |
Examples
Code Block |
---|
title | /cds/group/psdm/detector/calib2/epix100/logs/2022/2022-03-01T071247_log_det_dark_proc_akamalov.txt |
---|
collapse | true |
---|
|
[I] L0230 ________________________________________________________________________________
raw data found/selected in 1000 events
[I] L0233 begin data summary stage
[I] L0279 bad pixel status:
status 1: 300 pixel rms > 6.533
status 2: 1 pixel rms < 0.001
status 4: 1434 pixel intensity > 16000 in more than 0.1 fraction of events
status 8: 10170 pixel intensity < 1 in more than 0.1 fraction of events
status 16: 31 pixel average > 5280.34
status 32: 2 pixel average < 2692.9 |
Code Block |
---|
title | /cds/group/psdm/detector/gains2/epix10ka/panels/logs/2022/2022-04-06T163108_log_epix10ka_pedestals_calibration_xshen.txt |
---|
collapse | true |
---|
|
[I] L0275 Pre-processing time 16.339 sec
Results for median over pixels intensities:
0.500 fraction of the event spectrum is below 2901.542 ADU - pedestal estimator
0.050 fraction of the event spectrum is below 2896.826 ADU - gate low limit
0.950 fraction of the event spectrum is below 2906.187 ADU - gate upper limit
event spectrum spread median(abs(raw-med)): 1.869 ADU - spectral peak width estimator
[I] L0361 Bad pixel status:
status 1: 6 pixel rms > 3.898
status 2: 0 pixel rms < 0.944
status 4: 0 pixel intensity > 16000 in more than 0.1 fraction of events
status 8: 0 pixel intensity < 1 in more than 0.1 fraction of events
status 16: 2 pixel average > 3821.78
status 32: 0 pixel average < 1986.12 |
References