Reason for change

We have a new GlastRelease that includes a working GCRCalib. The cut to make FT1 files has been changed to use FSW gamma filter information. A pipeline module that does data consistency checks and that used to run only when we had all the data for a run will now run every time we process data for a run. And finally, this is the first iteration of setting realistic alarm limits based on the real data.

This version of L1Proc also fixes a certain number of problems seen in data processing. 

Test Procedure

We have processed real on-orbit data on the DEV server with this version of L1Proc. Fred Piron has signed off on that GCRCalib works as expected. Philippe Bruel has done the same thing for the FT1 cut change.

Rollback procedure

L1Proc can be rolled back to the previous version.

CCB Jira

SSC-87@JIRA

Details

L1Pipeline v1r59
- Look up run start&stop times from ACQSUMMARY rather than relying on the metadata supplied with the delivery. (LONE-76)
- Make our own magic7 file for use with ft2Runs. (LONE-82)
- Move deliveries to NFS when we're done with them.
- Use different directory in buffers when in test mode.
- The verify section is executed after mergeDigi.
- Use prune tree merger for svac.

GlastRelease v15r24:
- Includes a working GCRCalib.
- Systemtestsfor GR v15r24with respect to the previous production release, GR v15r21.
- RM diffwith respect to GR v15r21.

dataMonitoring/AlarmsCfg: v2r0p0
- Added config files for the Merit End-Of-Run and trending. We have not made the corresponding L1 pipeline processes yet.
- Added configuration files for the alarm postprocessing for all the quantity types---makes the debugging easier.
- First version with reasonable alarm limits.

dataMonitoring/FastMonCfg: v1r3p1
- Added quantity for the earth limb angle in baseConfig.xml. Relevant jira(s): GDQMQ-6.
- Added quantities : x and y axis Ra and Dec, earth limb infov, rock angle in baseConfig.xml. Relevant jira(s): GDQMQ-160, 167, 6.

dataMonitoring/DigiReconCalMeritCfg: v1r2p3
- Selection condsummary&32 changed to condsummary==32 for calcualtion of pedestals for ACD and CAL.
- New normalization factors were added: NormFactors_Run34FromFirstLight.txt. Those factors are computed using the real data from the satellite. This addresses Jira GDQMQ-189.
- Added rates of datagrams sent for EPUx. This addressed Jira GDQMQ-186.
- Added quantities FastMon_SpaceCraft_EarthLimb_FOV FastMon_SpaceCraft_EarthLimb FastMon_SpaceCraft_XaxisDec, FastMon_SpaceCraft_XaxisRA FastMon_SpaceCraft_RockAngle. Jira GDQMQ-187
- New quantities (Jira GDQMQ-184) and bug fixes (Jira GDQMQ-168, GDQMQ-183)
- New quantities related to jiras GDQMQ-181 and GDQMQ-186

dataMonitoring/Common: v3r2p0
- Handling of the error bars in the alg__values algoruthm rolled back due to a bug; need more work to have a functional version.
- Error representation for the trending quantities improved. Relevant jira(s): GDQMQ-57

dataMonitoring/FastMon: v3r4p2
- SCPosition and pGeomagProcessor : Add Z axis pointing in galactic coordinates L,B Relevant jira(s): GDQMQ-193
- M7Parser.py : Verify that the magic 7 starts with an ATT tag, tweak it if it s not the case
script. Relevant jira(s): GDQMQ-194
- Committed new file for merging the xml summary files from the ErrorHandler---this fixes a bug in the old script. Relevant jira(s):LONE-70
- Bug fix in pLATcomponentIterator: handleError now always return 0. Relevant jira(s): GDQMQ-192
- Bug fix in pSCposition getRockAngle was implemented twice, I do not even understand how that could work. Relevant jira(s): GDQMQ-187
- Added a get method for the earth limb angle in pSCPosition and added the quantity in pGeoMagProcessor. Relevant jira(s): GDQMQ-6
- Added the following quantities in pGeoMagProcessor : x and y axis Ra and Dec, earth limb infov, rock angle
- pSCPosition : Implement calculus of the earh limb, that looks ok, and a first trial at the arc angle of the earth limb in the field of view, not OK. GDQMQ-6
- pSCPosition : Major changes - Reorganize methods to get the axis pointing and FIX BUG in the calculation of the Rock angle that is now OK. GDQMQ-160 and GDQMQ-167
- pSCPosition : Major upgrade of the class with new members for X, Y and Z axis pointing in RA and DEC, new calculation and access methods, and BUG FIX for the ZRa and ZDec calculation, the quaternion was not defined as usual (w, x, y, z) but stands as (x, y ,z, w) in the magic7. ZRa and ZDec are now correct, so should it be for X and Y axis. GDQMQ-160 and GDQMQ-167.
- Relevant jira(s): GDQMQ-6, GDQMQ-160 and GDQMQ-167

svac/Monitor: v1r2p1
- New FastMon trending quantities X axis Ra and Dec, Rock angle and Earth Limb. Addresses Jira GDQMQ-187
- New quantities. Addresses Jira GDQMQ-184.
- Added FastMon quantities xaxis pointing, rock angle and earth limb. Addresses Jira GDQMQ-187
- Change retrieval of OB (offline) filters to account for leaked events.
- Changed sign of quntity Tick20MHzDeviation. This addresses Jira GDQMQ-180.
- Added quantity CurrentTimeToneMissing. This addresses Jira GDQMQ-164.
- Change function NormalizeRate (in RFun.cxx) so that, when magnetic info is meaningless, the return value is 0 if the requested value is Normalized error (and not the normalized value).
- Check value of MagneticInfo before using it in function NormalizeRate (class RFun.cxx). This prevents the crash of the program when the magnetic field quantity (PtMcIlwainL) is not present in merit file... yes... this can happen... The normalized quantities will be set to -1 if that occurs; i.e. it will not have any meaningful value.

svac/EngineeringModelRoot: v4r1p6
- Fixed type of Event ID. Still needs GR (digi and AnaTup) to catch up.

svac/TestReport: v6r14
- Removed the check for Ground ID.
- Pause is accepted as a valid closing reason (see LONE-83 and FSW-1078)

evtClassDefs v0r6
- Use FSW gamma filter information in cut to make the FT1 file. 

ft2Util: v1r2p23
- Added Quaternion Extrapolation.
- Minor changes for text output.
- Check on the GemID of the gaps.
- Check on the GemID of the gaps but does not exit if the ID are wrong. 

Complete set of tags for L1Proc 1.59

Code Versions

GlastRelease (sim/recon) v15r24*

ScienceTools (Level 2) : v9r5p5

Science Ops (task defs, scripts):

Level 1 pipeline code and applications running in L1:

svac/L1Pipeline: v1r59*

calibTkrUtil v2r2p4* 

dataMonitoring/AlarmsCfg: v2r0p0*
dataMonitoring/FastMonCfg: v1r3p1*

dataMonitoring/DigiReconCalMeritCfg: v1r2p3*

dataMonitoring/Common: v3r2p0*
dataMonitoring/FastMon: v3r4p2*
datMonitoring/IGRF: v1r0p1

svac/Monitor: v1r2p11*
svac/EngineeringModelRoot: v4r1p6*
svac/TestReport: v6r14*

users/richard/pipelineDatasets: v0r4

ft2Util: v1r2p23*

evtClassDefs v0r6*

GPLtools: v1r10