Validation After Leap Second Upgrade
GlastRelease 17-35-24-lp2224lp29 is now the current L1proc version of GR and will be used as our baseline. It uses FSW B1-3-0 as the base of our OBF external. It is built on glastlnx14 (RHEL4-32) via SCons.
GlastRelease - 17-35-24-gr27gr35 is the current test candidate of GR that is built on RHEL4-32 and RHEL5-32 via SCons. This required upgrading to FSW B3-0-0 for OBF and Gaudi v21r7-gl1.GlastRelease-new candidate GR
Johan's findings comparing the system test results of the RHEL4 builds of both tags are available here. In particular we need to clean up the Overlay system tests and determine why there are different numbers of events between the two versions in some of the low-level plots.
Discrepancy in number of entries in low-level plots
While the number of events simulated in 17-35-24-lp29 and 17-35-24-gr30 is identical to gr27, but falls back to OBF B1-1-3 for now, while JJ evaluates the cause for the differences in the OBF filter results.
Testing Real (evt) Data Take 2 May 7, 2012
Backed off to OBF B1-1-3 for now, continuing to test RHEL4 builds of 17-35-24-lp22 versus 17-35-24-gr30. Digi step performed on dole0030 and recon on kiso0067 as before.
Now the logs concerning the OBF data are identical.
gr35 are identical across the various system tests - the events generated are not. Here are some examples:
Section |
---|
|
Column |
---|
17-35-24-lp29 AllGamma FluxAlg INFO Computed Rate: 37.6639 Hz Source ID Source Name counts -1 all_gamma 40000 G4Generator INFO finalize: TkrCalibAlg INFO Finalize TkrCalibAlg TkrDigiMcToHitAlg INFO finalize TkrDigiNoiseAlg INFO finalize TkrDigiChargeAlg INFO finalize TkrDigiHitRemov... INFO finalize TkrDigiHitToDig... INFO finalize TkrDigiAlg INFO finalize TriggerAlg INFO Totals triggered/ processed: 40000/40000 bit frequency: all events value count CNO CALHI CALLO TKR ROI ---- --- --- --- --- --- 0 31862 0 0 0 0 0 2 3024 0 0 0 3024 0 3 983 0 0 0 983 983 4 1606 0 0 1606 0 0 6 1184 0 0 1184 1184 0 7 148 0 0 148 148 148 12 450 0 450 450 0 0 14 387 0 387 387 387 0 15 140 0 140 140 140 140 16 58 58 0 0 0 0 18 56 56 0 0 56 0 19 96 96 0 0 96 96 20 1 1 0 1 0 0 22 1 1 0 1 1 0 23 2 2 0 2 2 2 28 1 1 1 1 0 0 31 1 1 1 1 1 1 ---- --- --- --- --- --- tot: 40000 216 979 3921 6022 1370 trigger INFO counted 40000 times BackGndMixDC2 FluxAlg INFO Computed Rate: 130128 Hz Source ID Source Name counts 0 CrProtonPrimary 6168 1 CrProtonReentrant 1464 2 CrProtonSplash 1283 1000 CrElectronPrimary 60 1001 CrElectronReentrant 6490 1002 CrElectronSplash 6456 2000 CrPositronPrimary 6 2001 CrPositronReentrant 6898 2002 CrPositronSplash 6918 3000 CrAlpha 833 4000 CrHeavyIon 123 5000 Earth10 3301 G4Generator INFO finalize: TkrCalibAlg INFO Finalize TkrCalibAlg TkrDigiMcToHitAlg INFO finalize TkrDigiNoiseAlg INFO finalize TkrDigiChargeAlg INFO finalize TkrDigiHitRemov... INFO finalize TkrDigiHitToDig... INFO finalize TkrDigiAlg INFO finalize TriggerAlg INFO Totals triggered/ processed: 40000/40000 bit frequency: all events value count CNO CALHI CALLO TKR ROI ---- --- --- --- --- --- 0 35839 0 0 0 0 0 2 690 0 0 0 690 0 3 2417 0 0 0 2417 2417 4 187 0 0 187 0 0 6 68 0 0 68 68 0 7 424 0 0 424 424 424 12 9 0 9 9 0 0 14 1 0 1 1 1 0 15 40 0 40 40 40 40 16 144 144 0 0 0 0 18 10 10 0 0 10 0 19 96 96 0 0 96 96 20 7 7 0 7 0 0 22 3 3 0 3 3 0 23 53 53 0 53 53 53 31 12 12 12 12 12 12 ---- --- --- --- --- --- tot: 40000 325 62 804 3814 3042 trigger INFO counted 40000 times |
Column |
---|
17-35-24-gr35 AllGamma FluxAlg INFO Computed Rate: 38.0247 Hz Source ID Source Name counts -1 all_gamma 40000 G4Generator INFO finalize: TkrCalibAlg INFO Finalize TkrCalibAlg TkrDigiMcToHitAlg INFO finalize TkrDigiNoiseAlg INFO finalize TkrDigiChargeAlg INFO finalize TkrDigiHitRemov... INFO finalize TkrDigiHitToDig... INFO finalize TkrDigiAlg INFO finalize TriggerAlg INFO Totals triggered/ processed: 40000/40000 bit frequency: all events value count CNO CALHI CALLO TKR ROI ----- --- --- --- --- ---- 0 31749 0 0 0 0 0 2 3136 0 0 0 3136 0 3 898 0 0 0 898 898 4 1607 0 0 1607 0 0 6 1234 0 0 1234 1234 0 7 145 0 0 145 145 145 11 1 0 1 0 1 1 12 494 0 494 494 0 0 14 388 0 388 388 388 0 15 129 0 129 129 129 129 16 67 67 0 0 0 0 18 65 65 0 0 65 0 19 84 84 0 0 84 84 22 1 1 0 1 1 0 23 1 1 0 1 1 1 31 1 1 1 1 1 1 ----- --- --- --- --- ---- tot: 40000 219 1013 4000 6083 1259 trigger INFO counted 40000 times BackGndMixDC2 FluxAlg INFO Computed Rate: 131383 Hz Source ID Source Name counts 0 CrProtonPrimary 6132 1 CrProtonReentrant 1462 2 CrProtonSplash 1328 1000 CrElectronPrimary 54 1001 CrElectronReentrant 6463 1002 CrElectronSplash 6455 2000 CrPositronPrimary 2 2001 CrPositronReentrant 6986 2002 CrPositronSplash 6834 3000 CrAlpha 889 4000 CrHeavyIon 107 5000 Earth10 3288 G4Generator INFO finalize: TkrCalibAlg INFO Finalize TkrCalibAlg TkrDigiMcToHitAlg INFO finalize TkrDigiNoiseAlg INFO finalize TkrDigiChargeAlg INFO finalize TkrDigiHitRemov... INFO finalize TkrDigiHitToDig... INFO finalize TkrDigiAlg INFO finalize TriggerAlg INFO Totals triggered/ processed: 40000/40000 bit frequency: all events value count CNO CALHI CALLO TKR ROI ---- --- --- --- --- --- 0 36067 0 0 0 0 0 2 607 0 0 0 607 0 3 2299 0 0 0 2299 2299 4 170 0 0 170 0 0 6 71 0 0 71 71 0 7 417 0 0 417 417 417 12 9 0 9 9 0 0 14 3 0 3 3 3 0 15 32 0 32 32 32 32 16 158 158 0 0 0 0 18 10 10 0 0 10 0 19 105 105 0 0 105 105 20 8 8 0 8 0 0 22 2 2 0 2 2 0 23 37 37 0 37 37 37 28 1 1 1 1 0 0 31 4 4 4 4 4 4 ---- --- --- --- --- --- tot: 40000 325 49 754 3587 2894 trigger INFO counted 40000 times |
|
Validation After Upgrading to OBF B3-0-0-gl1
GlastRelease 17-35-24-lp28 is now the current L1proc version of GR and will be used as our basline. It uses FSW B3-0-0 (gl1) as the OBF external. It is built via SCons on glastlnx14 (RHEL4-32).
GlastRelease 17-35-24-gr31 is the new candidate GR moving back to OBF B3-0-0 and includes patches to Overlay and the event display handling.
First Attempts
GlastRelease 17-35-24-lp22 is the current L1proc version of GR and will be used as our baseline. It uses FSW B1-3-0 as the base of our OBF external. It is built on glastlnx14 (RHEL4-32) via SCons.
GlastRelease-17-35-24-gr27 is the current test candidate of GR that is built on RHEL4-32 and RHEL5-32 via SCons. This required upgrading to FSW B3-0-0 for OBF and Gaudi v21r7-gl1.
GlastRelease-17-35-24-gr30 is identical to gr27, but falls back to OBF B1-1-3 for now, while JJ evaluates the cause for the differences in the OBF filter results.
System Tests
GlastRelease-17-35-24-gr30 versus GlastRelease-17-35-24-lp22
http://glast-ground.slac.stanford.edu/SystemTests/?releaseVersionId=13221
The many differences are likely attributable to the different random number seeds applied. A new run is being prepared.
Testing Real (evt) Data Take 2 May 7, 2012
Backed off to OBF B1-1-3 for now, continuing to test RHEL4 builds of 17-35-24-lp22 versus 17-35-24-gr30. Digi step performed on dole0030 and recon on kiso0067 as before.
Now the digitization logs concerning the OBF data are identical. Comparing the reconstruction logs, one notices that the merit values are not identical across the board:
Section |
---|
|
Column |
---|
GR 17-35-24-lp22 RootTupleSvc WARNING Found 71 bad events: table of bad values follows Name count AcdActiveDist3DErr 45 AcdTkr1ActiveDistErr 46 CalCfpCalChiSq 1 CalCfpCalEffRLn 1 |
Column |
---|
GR 17-35-24-gr30 RootTupleSvc WARNING Found 70 bad events: table of bad values follows Name count AcdActiveDist3DErr 45 AcdTkr1ActiveDistErr 46 |
|
We then tried using Luca Baldini's meritDiff.py to compare the resulting merit files (this is available in CVS users/lbaldini/MeritDiff):
MeritUtils/python/meritDiff.py -n 66429 -d 1e-3 GR-17-35-24-lp22-rhel4build-merit.root test-newGaudi/test-gr30/GR-17-35-24-gr30-rhel4build-merit.root
*** Event @ row 15:
CalCfpCalEnergy: 1580.19 vs. 1229.07
*** Event @ row 20:
CalCfpCalFitErrFlg: 4.0 vs. 0.0
So the differences seem centered on the CalCfp** calculations.
System tests for 17-35-24-gr30 versus 17-35-24-lp22 have been runUsing Luca Baldini's MeritDiff.py to compare the resulting merit files.
Testing Real (evt) Data Processing
...