Reason for change
We now have a new GlastRelease that has the real onboard filter status bits available in the digi file. In combination with this we have added new monitoring quantities based on these and also updated the SVAC ntuple. Note that this in particular include the DGN bits i.e. for the first time we have monitoring of an unbiased sample.
This GR also contains the TKR alignment used through the calibration meta-database like all the other calibration files. The relevant calibration files (inter- and intra-tower) have been added to the calibration meta-database and are now being used by default in data processing in the L1 pipeline.
We have also clarified where to pick up the particle type cuts (transient etc) and made sure the cuts used in the monitoring are the same as the one used for the instrument response functions.
Note that this GR needs a new version of DFI which has to be deployed in synch. Also note that Flight Ops are keen on deploying asap as the new DFI request on their side comes in combination with needed Mission Planning updates.
Test Procedure
We have processed real data on the DEV server with this version of L1Proc. Testing has been complicated by the fact that we have needed the NIGHTLY ISOC software environment to pick up the new DFI and that we could not use our usual evt files since the format has changed.
An additional complication has been that we only could use ground data runs to test the new monitoring quantities. Ops Sim 2 or any other MC that has gone through the usual Ebf2Ccsds only contain the real Passtru bit and are useless for testing the (other) real filter status bits. I'm working with Gregg to find a way to solve this for the future. Note that the absence of a host side LPA means that even in the best of cases only one filter can run at any given time on an EBF file (I'm told there is a denied FSW CCB request that would have solved this. Oh well.). So MC files processed in the L1 pipeline will never contain a full set of 'real' filter status bits. This makes testing difficult as ground data doesn't look like on-orbit data.
Rollback procedure
L1Proc can be rolled back to the previous version (in synch with DFI).
CCB Jira
Details
L1Pipeline v1r54
- Updated to the use the new GR and newest set of monitoring tags.
- Be more paranoid about cleaning up crumb-level files LONE-61.
- PipelineStaging6 is having reliability issues, we're not using it for now.
GlastRelease v15r5:
- This GR depends on the new DFI and contains the real filter status bits.
- Systemtestsfor GR v15r5wrt GR v15r2 show no differences as the real filter bits are not part of the system tests and (for the TKR alignment) there are still no data runs in the system tests.
- RM diffwith respect to the previous production release, GR v15r2.
- A few words about testing the real filter status bits: I have verified on a handful of real data events that there is agreement between the information in the evt file and the digi file for the GAMMA, MIP and DGN filters concerning which filters passed the events. Unfortunately I have not found any events in ground data that pass the HIP-filter. As I can not use MC (for the reasons detailed above) I have not been able to explicitly verify that the HIP-filter bits are properly set. Neither has anybody else.
dataMonitoring/DigiReconCalMeritCfg: v1r1p21
- Corrected few typos in merit trending parameters. This addresses Jira GDQMQ-137.
- Added merit parameters. This addresses Jira GDQMQ-137.
- Changed normalization in quantities that relate Flight Software and Gleam filter bits (file monconfig_digi_trending.xml). This addresses Jira GDQMQ-132.
- Added a bunch of new quantities related to the real flight software filter bits. This addresses Jira GDQMQ-132.
- Added Log10 of measured energy (recon job; monconfig_recon_histos.xml). This will show all features in the energy spectra. This addresses Jira GDQMQ-128.
dataMonitoring/FastMon: v3r1p5
- Bug Fix, change modf to fmod in the routine calculating the longitude in pSCPosition.py, as done in ST astro package. Relevant jira(s): GDQMQ-133
svac/Monitor: v1r1p19
- "Add gamma->has()" MonInput_FswFilters_GammaBits.cxx
- Change definition of prescales in class MonInput_DGNGemPrescale.cxx.
- Changes in code to compile with the new glast release (GlastRelease-HEAD1.1097). Those issues address the jira GDQMQ-132.
- Changes in code to compile with the new glast release (GlastRelease-HEAD1.1096).
- Add merit parameters. Those issues address the jiras GDQMQ-137 and GDQMQ-132.
- Define Branch name for filter bits info retrieval. Changed Passed() by passed(). This address Jira GDQMQ-132.
- Added new quantities to retrieve the real flight software filter bits. This addresses Jira GDQMQ-132.
svac/EngineeringModelRoot: v4r0p0
- Added real FSW filter status information. Needs the new DFI!
calibTkrUtil: v2r2p3
- Bug fix to avoid division by zero.
Complete set of tags for L1Proc 1.54
Code Versions
GlastRelease (sim/recon) v15r5
ScienceTools (Level 2) : v9r5p4
Science Ops (task defs, scripts):
Level 1 pipeline code and applications running in L1:
svac/L1Pipeline: v1r54*
dataMonitoring/AlarmsCfg: v1r1p1
dataMonitoring/FastMonCfg: v1r1p11
dataMonitoring/DigiReconCalMeritCfg: v1r1p21*
dataMonitoring/Common: v3r1p5
dataMonitoring/FastMon: v3r1p5*
datMonitoring/IGRF: v1r0p1
svac/Monitor: v1r1p19*
svac/EngineeringModelRoot: v4r0p0*
svac/TestReport: v6r8
calibTkrUtil: v2r2p3*
users/richard/pipelineDatasets: v0r4
ft2Util: v1r2p15
evtClassDefs v0r4
GPLtools: v1r10