Reason for change
On Monday we will process 5 days worth of real data from the LAT from Ops Sims and ETEs from Thursday-Monday. These changes are needed to properly process this data.
We have a new GlastRelease that correctly deals with the run number for data in pipeline 2. We have a new version of ft2Util with improved interpolations and which also avoids NaN seen in Ops Sim 2 in addition to dealing with gaps in the event data. And finally there is a new version of the SVAC ntuple that no longer runs code that was producing things we don't use anymore in pipeline 2.
Note that because of the way the Magic 7 file is generated when we make L0 files from MC, the validity time of the Magic 7 file is sometimes a little shorter than the event data, we have had to make fake M7 entries at the start and end of MC runs. This is because Gleam will stop if an event is outside the corresponding FT2_Gleam validity time. It doesn't matter if it's a tiny fraction of a second. Because of technical reasons, FSW uses the start of the Magic 7 file to seed the absolute event time, padded Magic 7 files can not be directly produced. These fake Magic 7 entries caused NaN as seen in Ra and Dec in Ops Sim 2. This version of ft2Util does not make these fake Magic 7 entries. It will, thus, only work properly with real data where this issue of short Magic 7 files do not appear. It is also important to gain experience with real Magic 7 files and real data losses.
Test Procedure
We have processed real data on DEV with this version of L1Proc.
Rollback procedure
We can roll back to the previous version of L1Proc.
CCB Jira
Details
GlastRelease v13r11p6:
Systemtests show no differences wrt to current GR v13r11p4 in L1Proc.
lsfData v2r0:
- v2r0 17-Apr-2008 HMK Add RunInfo::dataTransferId to store the runid in response to JIRA ROOT-34.
ldfReader v4r0:
- v4r0 17-Apr-2008 hmk JIRA ROOT-34, change default method for setting the runid, to use ctx.run.startedAt, rather than LSEReader::runid()
- v3r34 15-Apr-2008 awb Updated flags for time stamp calculation: JIRA GRINF-46.
digiRootData v10r3:
- v10r3 17-Apr-2008 HMK add in RunInfo::dataTransferId to address JIRA ROOT-34
- v10r2 31-Mar-2008 TU HMK tagging Tracy's update to TkrDigi to use the new DigiObjectManager
RootConvert v1r30:
- v1r30 17-Apr-2008 HMK address JIRA ROOT-34 to add in RunInfo::dataTransferId
LdfConverter v4r0:
- v4r0 17-Apr-2007 HMK JIRA ROOT-34 adding new JO parameter OldStyleRunId which defaults to false, but when set to true, will obtain the runId the same way I&T did, rather than the method that is used for flight via the ctx.run.startedAt item
AnalysisNtuple v2r32gr2:
- v2r32gr2 16-Apr-08 HMK Include patch to EventAuditor on this branch
Gleam v6r33p17: Note that all but one of these new tags are old (pre-freeze). Most do not affect pipeline job options.
- v6r33p17 awb 16-Apr-08 Added 'TriRowBitsAlg' to pipeline JO. JIRA GRINF-34.
- v6r33p16 HMK 12-Mar-08 Comment out LATCalibRoot in requirements file like it should be
- v6r33p15 HMK 12-Mar-08 Update calibrations.txt to set FlavorRibbon="ideal"
- v6r33p14 HMK 10-Mar-08 Add use of CalibSvc so that when building Gleam CalibSvc will be as well includes Toby's updates to calibration.txt
- v6r33p13 AWB 15-JAN-08 Yet another filter JO update for pipeline.
- v6r33p12 AWB 15-JAN-08 Filter JO update for pipeline.
- v6r33p11 LSR 15-Jan-08 Another little fix to jobOptions.txt
- v6r33p10 LSR 15-Jan-08 Add EventAuditor to basicOptions. Add placeholder for UserAlg: Sequencer/User
- v6r33p9 AWB 11-JAN-08 Updated I&T mc.txt with correct ACD calibrations.
- v6r33p8 AWB 07-JAN-08 Updated I&T mc.txt with trigger config.
svac/EngineeringModelRoot v3r14:
- Commented out TKR histogram code which produce histograms we don't use in pipeline 2.
- Not building extra applications not used by the pipeline by default anymore.
- Added AcdCnoMap. JIRA SVAC-110.
ft2Util v1r2p8:
- ORB interpolation via Parabola or the method used by gtbary: LONE-34
- ATT interpolation via SLERP: LONE-35
- Flag for quality of the interpolations: LONE-36
- Digi Time calibration: LONE-33
- Handling of Digi file Gaps: LONE-37
- Magic7 read in order to have ATT and ORB entries right at Tstart of a FT2 bin: LONE-38
- Corrected interpolation ATT flag on output file: LONE-36
- Correction of the Attitude interpolation flag in the textual version of the ft2 file. LONE-40
- Interpolation in Attitude entries are often necessary even if the Magic7 file has no gaps. When it is not possible to use SLERP (specially at the end or beginning of a run),
quaternion etrapolations via angular velocities may make crash Gleam. This can be fixed avoiding to pad entries at the edges of the ft2 file, and simply widening the time span
give by run start and stop: LONE-41
- Correction apported in v1r2p6 generated a bug in the code reading Magic7 file, when the time span between first Digi event and firs line in the Magic7 file is larger than 1 second: LONE-42
- ft2Utils checks that RunId in the Gasp file match RunId of the DigiFile: LONE-43
Complete set of tags for L1Proc 1.45
Code Versions
GlastRelease (sim/recon) v13r11p6*
ScienceTools (Level 2) : v9r5
Science Ops (task defs, scripts):
Level 1 pipeline code and applications running in L1:
svac/L1Pipeline: v1r45*
dataMonitoring/AlarmsCfg: v1r0p4
dataMonitoring/FastMonCfg: v1r0p10
dataMonitoring/DigiReconCalMeritCfg: v1r0p15
dataMonitoring/Common: v3r0p13
dataMonitoring/FastMon: v3r0p13
datMonitoring/IGRF: v1r0p1
svac/Monitor: v1r0p13
svac/EngineeringModelRoot: v3r14*
svac/TestReport: v5r8
users/richard/pipelineDatasets: v0r4
ft2Util: v1r2p8*
GPLtools: v1r10