Versions Compared

Old Version 23

changes.mady.by.user Mikhail Dubrovin

Saved on

compared with

New Version Current

changes.mady.by.user Mikhail Dubrovin

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

2023-04-06 Feature 2 and 3 for dark data vs our standard dark processing

  • dark data set: exp=xpplw3319:run=287

...

  • detector: XppGon.0:Epix100a.3, alias: epix_alc3
  • This data set contains ~1200 events, of which initial 1000 is used in processing.
  • By default features 1,2,3 are used. Feature 4 and 5 for gain factors are not implemented and are irrelevant to epix100a.
  • Feature 1 - good frame selection discards 1/0/0 frames for SNR=3/5/8, respectively


Code Block
titleResults for SNR max = 3,5,8
collapsetrue
det_raw_pixel_status -d exp=xpplw3319:run=287 -s XppGon.0:Epix100a.3 -n 1000 -R3 --gmode SNR3

Summary of the bad pixel status evaluation for SNR = 3.00, status_data array
                   0o1:     6445 / 540672 ( 1.192%) pixels Feat.2 mean <= 3588.608
                   0o2:    13484 / 540672 ( 2.494%) pixels Feat.2 mean >= 4374.797
                   0o4:     5600 / 540672 ( 1.036%) pixels Feat.3 std <= 2.314
                  0o10:    34098 / 540672 ( 6.307%) pixels Feat.3 std >= 3.263
    Any bad status bit:    57409 / 540672 (10.618%) pixels


det_raw_pixel_status -d exp=xpplw3319:run=287 -s XppGon.0:Epix100a.3 -n 1000 -R5 --gmode SNR5

Summary of the bad pixel status evaluation for SNR=5.00, status_data array
                   0o1:        5 / 540672 ( 0.001%) pixels Feat.2 mean <= 3326.536
                   0o2:       87 / 540672 ( 0.016%) pixels Feat.2 mean >= 4636.866
                   0o4:      878 / 540672 ( 0.162%) pixels Feat.3 std <= 1.999
                  0o10:    12739 / 540672 ( 2.356%) pixels Feat.3 std >= 3.579
    Any bad status bit:    13675 / 540672 ( 2.529%) pixels


det_raw_pixel_status -d exp=xpplw3319:run=287 -s XppGon.0:Epix100a.3 -n 1000 -R8 --gmode SNR8

Summary of the bad pixel status evaluation for SNR=8.00, status_data array
                   0o1:        0 / 540672 ( 0.000%) pixels Feat.2 mean <= 2933.437
                   0o2:       33 / 540672 ( 0.006%) pixels Feat.2 mean >= 5029.965
                   0o4:        0 / 540672 ( 0.000%) pixels Feat.3 std <= 1.525
                  0o10:     5314 / 540672 ( 0.983%) pixels Feat.3 std >= 4.053
    Any bad status bit:     5319 / 540672 ( 0.984%) pixels

...

Code Block
titlepixel_status from regular dark processing
collapsetrue
det_ndarr_raw_proc -d exp=xpplw3319:run=287 -s XppGon.0:Epix100a.3 -n 1000 -o work

raw data found/selected in 1000 events
[I] UtilsCalib.py L0683 begin data summary stage
[I] UtilsCalib.py L0112 evaluate_limits RMS: ave=2.317 std=0.370  limits low=0.097 high=4.536
[I] UtilsCalib.py L0112 evaluate_limits AVE: ave=3983.565 std=188.830  limits low=2850.584 high=5116.546
[I] UtilsCalib.py L0721 bad pixel status:
  status  1:      643 pixel rms       > 4.536
  status  2:        0 pixel rms       < 0.097
  status  4:        0 pixel intensity > 16000 in more than 0.1 fraction (99/999) of non-empty events
  status  8:        0 pixel intensity < 1 in more than 0.1 fraction (99/999) of non-empty events
  status 16:       31 pixel average   > 5116.55
  status 32:        0 pixel average   < 2850.58

REFERENCES

2023-04-06 Feature 6 for regular data for SNR=3 and 5

  • dark data set: exp=xpplw3319:run=287
  • detector: XppGon.0:Epix100a.3, alias: epix_alc3
Code Block
titleFeature 6 for SNR=3 and 5
collapsetrue
det_raw_pixel_status -d exp=xpplw3319:run=293 -s XppGon.0:Epix100a.3 -n 1000 -R3 --gmode SNR3-F6 -F 1,6
Summary of the bad pixel status evaluation for SNR=3.00, status_data array
                   0o1:      449 / 540672 ( 0.083%) pixels Feat.6 res_med <= -330.137
                   0o2:      379 / 540672 ( 0.070%) pixels Feat.6 res_med >= 331.245
                   0o4:     8305 / 540672 ( 1.536%) pixels Feat.6 res_spr <= 1.472
                  0o10:    34625 / 540672 ( 6.404%) pixels Feat.6 res_spr >= 2.095
    Any bad status bit:    43648 / 540672 ( 8.073%) pixels

det_raw_pixel_status -d exp=xpplw3319:run=293 -s XppGon.0:Epix100a.3 -n 1000 -R5 --gmode SNR5-F6 -F 1,6
Summary of the bad pixel status evaluation for SNR=5.00, status_data array
                   0o1:        0 / 540672 ( 0.000%) pixels Feat.6 res_med <= -550.599
                   0o2:       45 / 540672 ( 0.008%) pixels Feat.6 res_med >= 551.708
                   0o4:     1005 / 540672 ( 0.186%) pixels Feat.6 res_spr <= 1.265
                  0o10:    12484 / 540672 ( 2.309%) pixels Feat.6 res_spr >= 2.302
    Any bad status bit:    13501 / 540672 ( 2.497%) pixels

Image AddedImage Added

Interim summary

  • Number of bad pixels depends on SNR parameter
  • Stripe of bad pixels in the middle of the detector can be caught by Feature 3 and 6 at SNR=5.
  • "Scratch" observed by Chuck is not seen detected ...

2023-04-07 mtg summary

  • Chuck: try to search for scratch in ASIC ONLY!
  • Chris: try to change gate limits in dark processing to reproduce bad pixel in the middle stripe.

2023-05-12 low gain pixels

det_calib_ave_and_max -d exp=xpplw3319:run=293 -s XppGon.0:Epix100a.3 -n 100000

generates max-peds for 35998 events of xpplw3319-r0293

img-XppGon-0-Epix100a-3-xpplw3319-r0293-e035998-mode-p-max.npy

Image Added

use test algorithm test-2023-04-26-chuck.py

from img-XppGon-0-Epix100a-3-xpplw3319-r0293-e035998-mode-p-max.npy

find median and +/- 6 * (median of difference)

max-peds: shape:(704, 768) size:540672 dtype:float32 [135.05005 135.3999  177.94995 180.53003 176.6001 ...]


Summary of the bad pixel status evaluation
                   0o1:    10021 / 540672 ( 1.853%) pixels max-peds <= 127.788
                   0o2:     3689 / 540672 ( 0.682%) pixels max-peds >= 203.811
saved arr_status_med-peds.npy

           arr_status_med-peds.txt

cp arr_status_med-peds.txt /cds/data/psdm/xpp/xpplw3319/calib/Epix100a::CalibV1/XppGon.0:Epix100a.3/status_extra/0-end.data

see Bad Pixel Status

Image Added

REFERENCES