status: Complete
last update: 4 June 2014
This task re-creates the FT1 (and EXTENDEDFT1) files for Fermi's entire science mission. It does nothing more than recalculate the diffuse response columns in these data products after a problem was reported in January 2014. There are four diffuse response columns filled: galactic and isotropic for both source and clean events.
P203-FITS - This task reads MERIT and produces FT1 (photons) + EXTENDEDFT1
This task is identical with P202-FITS with the following exceptions:
Refer to the P202 documentation for additional configuration details.
Refer to the Official LAT Datasets to see how these data fit into the big picture.
Bookkeeping
This task generates FT1 and EXTENDEDFT1 data products.
3/4/2014 - Configure Block 2, consisting of Level 1 data since 5 Nov 2013 through 28 Feb 2014. Begin trickleStream.
#runs | 30915 | |
---|---|---|
#evts | 67249594218 | |
start | 239557417 | 2008-08-04 15:43:37 |
stop | 415328595 | 2014-03-01 01:03:15 |
6/3/2014 16:05 - Block 4 complete. Summary from dataCatalog:
Name | Type | Files | Events | Size |
---|---|---|---|---|
EXTENDEDFT1 | Group | 32342 | 10,325,038,320 | 904.7 GB |
FT1 | Group | 32342 | 360,437,538 | 32.4 GB |
8/20/2014 - rollback run 27487 (run 395891323) with newly produced MERIT and FT2 files (see longer explanation in the P202 page).
Configuration
Identical with P202-FITS except:
Diffuse Model | based on contents of /afs/slac.stanford.edu/g/glast/ground/GLAST_EXT/diffuseModels/v4r1 |
Output Data Products |
Generation of output data products:
Data Product | destination | data content [1] | event selection [1] | makeFT1 | gtselect | gtdiffrsp | gtmktime |
---|---|---|---|---|---|---|---|
EXTENDEDFT1 | SLAC | FT1variables | ((FT1EventClass & 0x00003EFF)!=0) | ||||
FT1 | FSSC+SLAC | FT1variables | 'source' and above | (inherited) |
Note that diffuse response is calculated for 'source' and 'clean' event classes only.
Timing
1) Refer to the modified files already in the DCtest task on /u38 which was used to prototype this change
2) update repTools.py with new version of getCurrentVersion(), and make a completely
new release 00-01-05. Note that findFt2() is now obsolete.
3) In the P203-FITS/config directory, make these changes:
>> config.py - change pointer to new version of commonTools
>> setupRun.py - prepare list of output data product types
>> createClumps.jy - query for FT2 file name and store in pipeline var
>> processClump.py - fetch FT2 file name directly from pipeline var rather than via query
>> setupMerge.jy - query for latest file version of each output data type
>> mergeClumps.py - make pipeline vars -> env-vars
4) The usual git commit/tag/push