Validation After Leap Second Upgrade
GlastRelease 17-35-24-lp2224lp29 is now the current L1proc version of GR and will be used as our baseline. It uses FSW B1-3-0 as the base of our OBF external. It is built on glastlnx14 (RHEL4-32) via SCons.
GlastRelease - 17-35-24-gr27gr35 is the current test candidate of GR that is built on RHEL4-32 and RHEL5-32 via SCons. This required upgrading to FSW B3-0-0 for OBF and Gaudi v21r7-gl1new candidate GR
Johan's findings comparing the system test results of the RHEL4 builds of both tags are available here. In particular we need to clean up the Overlay system tests and determine why there are different numbers of events between the two versions in some of the low-level plots.
Discrepancy in number of entries in low-level plots
While the number of events simulated in 17-35-24-lp29 and 17-35-24-gr35 are identical across the various system tests - the events generated are not. Here are some examples:
| Section |
|---|
|
| Column |
|---|
17-35-24-lp29 AllGamma FluxAlg INFO Computed Rate: 37.6639 Hz
Source ID Source Name counts
-1 all_gamma 40000
G4Generator INFO finalize:
TkrCalibAlg INFO Finalize TkrCalibAlg
TkrDigiMcToHitAlg INFO finalize
TkrDigiNoiseAlg INFO finalize
TkrDigiChargeAlg INFO finalize
TkrDigiHitRemov... INFO finalize
TkrDigiHitToDig... INFO finalize
TkrDigiAlg INFO finalize
TriggerAlg INFO Totals triggered/ processed: 40000/40000
bit frequency: all events
value count CNO CALHI CALLO TKR ROI
---- --- --- --- --- ---
0 31862 0 0 0 0 0
2 3024 0 0 0 3024 0
3 983 0 0 0 983 983
4 1606 0 0 1606 0 0
6 1184 0 0 1184 1184 0
7 148 0 0 148 148 148
12 450 0 450 450 0 0
14 387 0 387 387 387 0
15 140 0 140 140 140 140
16 58 58 0 0 0 0
18 56 56 0 0 56 0
19 96 96 0 0 96 96
20 1 1 0 1 0 0
22 1 1 0 1 1 0
23 2 2 0 2 2 2
28 1 1 1 1 0 0
31 1 1 1 1 1 1
---- --- --- --- --- ---
tot: 40000 216 979 3921 6022 1370
trigger INFO counted 40000 times BackGndMixDC2 FluxAlg INFO Computed Rate: 130128 Hz
Source ID Source Name counts
0 CrProtonPrimary 6168
1 CrProtonReentrant 1464
2 CrProtonSplash 1283
1000 CrElectronPrimary 60
1001 CrElectronReentrant 6490
1002 CrElectronSplash 6456
2000 CrPositronPrimary 6
2001 CrPositronReentrant 6898
2002 CrPositronSplash 6918
3000 CrAlpha 833
4000 CrHeavyIon 123
5000 Earth10 3301
G4Generator INFO finalize:
TkrCalibAlg INFO Finalize TkrCalibAlg
TkrDigiMcToHitAlg INFO finalize
TkrDigiNoiseAlg INFO finalize
TkrDigiChargeAlg INFO finalize
TkrDigiHitRemov... INFO finalize
TkrDigiHitToDig... INFO finalize
TkrDigiAlg INFO finalize
TriggerAlg INFO Totals triggered/ processed: 40000/40000
bit frequency: all events
value count CNO CALHI CALLO TKR ROI
---- --- --- --- --- ---
0 35839 0 0 0 0 0
2 690 0 0 0 690 0
3 2417 0 0 0 2417 2417
4 187 0 0 187 0 0
6 68 0 0 68 68 0
7 424 0 0 424 424 424
12 9 0 9 9 0 0
14 1 0 1 1 1 0
15 40 0 40 40 40 40
16 144 144 0 0 0 0
18 10 10 0 0 10 0
19 96 96 0 0 96 96
20 7 7 0 7 0 0
22 3 3 0 3 3 0
23 53 53 0 53 53 53
31 12 12 12 12 12 12
---- --- --- --- --- ---
tot: 40000 325 62 804 3814 3042
trigger INFO counted 40000 times |
| Column |
|---|
17-35-24-gr35 AllGamma FluxAlg INFO Computed Rate: 38.0247 Hz
Source ID Source Name counts
-1 all_gamma 40000
G4Generator INFO finalize:
TkrCalibAlg INFO Finalize TkrCalibAlg
TkrDigiMcToHitAlg INFO finalize
TkrDigiNoiseAlg INFO finalize
TkrDigiChargeAlg INFO finalize
TkrDigiHitRemov... INFO finalize
TkrDigiHitToDig... INFO finalize
TkrDigiAlg INFO finalize
TriggerAlg INFO Totals triggered/ processed: 40000/40000
bit frequency: all events
value count CNO CALHI CALLO TKR ROI
----- --- --- --- --- ----
0 31749 0 0 0 0 0
2 3136 0 0 0 3136 0
3 898 0 0 0 898 898
4 1607 0 0 1607 0 0
6 1234 0 0 1234 1234 0
7 145 0 0 145 145 145
11 1 0 1 0 1 1
12 494 0 494 494 0 0
14 388 0 388 388 388 0
15 129 0 129 129 129 129
16 67 67 0 0 0 0
18 65 65 0 0 65 0
19 84 84 0 0 84 84
22 1 1 0 1 1 0
23 1 1 0 1 1 1
31 1 1 1 1 1 1
----- --- --- --- --- ----
tot: 40000 219 1013 4000 6083 1259
trigger INFO counted 40000 times BackGndMixDC2 FluxAlg INFO Computed Rate: 131383 Hz
Source ID Source Name counts
0 CrProtonPrimary 6132
1 CrProtonReentrant 1462
2 CrProtonSplash 1328
1000 CrElectronPrimary 54
1001 CrElectronReentrant 6463
1002 CrElectronSplash 6455
2000 CrPositronPrimary 2
2001 CrPositronReentrant 6986
2002 CrPositronSplash 6834
3000 CrAlpha 889
4000 CrHeavyIon 107
5000 Earth10 3288
G4Generator INFO finalize:
TkrCalibAlg INFO Finalize TkrCalibAlg
TkrDigiMcToHitAlg INFO finalize
TkrDigiNoiseAlg INFO finalize
TkrDigiChargeAlg INFO finalize
TkrDigiHitRemov... INFO finalize
TkrDigiHitToDig... INFO finalize
TkrDigiAlg INFO finalize
TriggerAlg INFO Totals triggered/ processed: 40000/40000
bit frequency: all events
value count CNO CALHI CALLO TKR ROI
---- --- --- --- --- ---
0 36067 0 0 0 0 0
2 607 0 0 0 607 0
3 2299 0 0 0 2299 2299
4 170 0 0 170 0 0
6 71 0 0 71 71 0
7 417 0 0 417 417 417
12 9 0 9 9 0 0
14 3 0 3 3 3 0
15 32 0 32 32 32 32
16 158 158 0 0 0 0
18 10 10 0 0 10 0
19 105 105 0 0 105 105
20 8 8 0 8 0 0
22 2 2 0 2 2 0
23 37 37 0 37 37 37
28 1 1 1 1 0 0
31 4 4 4 4 4 4
---- --- --- --- --- ---
tot: 40000 325 49 754 3587 2894
trigger INFO counted 40000 times |
|
Validation After Upgrading to OBF B3-0-0-gl1
GlastRelease 17-35-24-lp28 is now the current L1proc version of GR and will be used as our basline. It uses FSW B3-0-0 (gl1) as the OBF external. It is built via SCons on glastlnx14 (RHEL4-32).
GlastRelease 17-35-24-gr31 is the new candidate GR moving back to OBF B3-0-0 and includes patches to Overlay and the event display handling.
First Attempts
GlastRelease 17-35-24-lp22 is the current L1proc version of GR and will be used as our baseline. It uses FSW B1-3-0 as the base of our OBF external. It is built on glastlnx14 (RHEL4-32) via SCons.
GlastRelease-17-35-24-gr27 is the current test candidate of GR that is built on RHEL4-32 and RHEL5-32 via SCons. This required upgrading to FSW B3-0-0 for OBF and Gaudi v21r7-gl1.
GlastRelease-17-35-24-gr30 is identical to gr27, but falls back to OBF B1-1-3 for now, while JJ evaluates the cause for the differences in the OBF filter results.
System Tests
GlastRelease-17-35-24-gr30 versus GlastRelease-17-35-24-lp22
http://glast-ground.slac.stanford.edu/SystemTests/?releaseVersionId=13221
The many differences are likely attributable to the different random number seeds applied. A new run is being prepared.
Testing Real (evt) Data Take 2 May 7, 2012
Backed off to OBF B1-1-3 for now, continuing to test RHEL4 builds of 17-35-24-lp22 versus 17-35-24-gr30. Digi step performed on dole0030 and recon on kiso0067 as before.
Now the digitization logs concerning the OBF data are identical. Comparing the reconstruction logs, one notices that the merit values are not identical across the board:
| Section |
|---|
|
| Column |
|---|
GR 17-35-24-lp22 RootTupleSvc WARNING Found 71 bad events: table of bad values follows
Name count
AcdActiveDist3DErr 45
AcdTkr1ActiveDistErr 46
CalCfpCalChiSq 1
CalCfpCalEffRLn 1 |
| Column |
|---|
GR 17-35-24-gr30 RootTupleSvc WARNING Found 70 bad events: table of bad values follows
Name count
AcdActiveDist3DErr 45
AcdTkr1ActiveDistErr 46 |
|
We then tried using Luca Baldini's meritDiff.py to compare the resulting merit files (this is available in CVS users/lbaldini/MeritDiff):
MeritUtils/python/meritDiff.py -n 66429 -d 1e-3 GR-17-35-24-lp22-rhel4build-merit.root test-newGaudi/test-gr30/GR-17-35-24-gr30-rhel4build-merit.root
*** Event @ row 15:
CalCfpCalEnergy: 1580.19 vs. 1229.07
*** Event @ row 20:
CalCfpCalFitErrFlg: 4.0 vs. 0.0
So the differences seem centered on the CalCfp** calculations.
System tests for 17-35-24-gr30 versus 17-35-24-lp22 have been run.
Testing Real (evt) Data Processing
...