P106 Reprocessing
status: In Progress
last update: 11 May 2010
This page is a record of the configuration for the P106 reprocessing project. It targets 200 runs of L&EO data for processing with a new alignment and other improvements to investigate issues with the Pass7 classification.
The name "P106" derives from the word "processing" and the initial file version to be used for the output data products, e.g., r0123456789_v106_merit.root.
- P106-LEO-MERIT - this task reads DIGI, runs the full reconstruction code in Gleam and produces reprocessed RECON + MERIT + CAL + GCR
- P106-LEO-FITS - this task will read MERIT and produce FT1 (photons)
Datafile names, versions and locations
Data file version numbers for this reprocessing will begin with v106.
XROOT location and file naming
Location template:
/glast/Data/Flight/Reprocess/<reprocessName>/<dataType>
Locations for P106-LEO:
/glast/Data/Flight/Reprocess/P106-LEO/merit
And so forth for the other file types produced.
File naming:
Data Type |
Naming template |
---|---|
MERIT, RECON, GCR, CAL |
r<run#>_<version>_<dataType>.root |
FT1 |
gll_ph_r<run#>_<version>.fit |
Example:
/glast/Data/Flight/Reprocess/P106-LEO/merit/r0239557414_v106_merit.root /glast/Data/Flight/Reprocess/P106-LEO/ft1/gll_ph_r0239559565_v106.fit
DataCatalog location and naming
Logical directory and group template:
Data/Flight/Reprocess/<reprocessName>:<dataType>
Note that the <dataType> field (following the colon) is a DataCatalog 'group' name.
Logical directories for P106-LEO:
Data/Flight/Reprocess/P106-LEO:MERIT Data/Flight/Reprocess/P106-LEO:FT1
And so forth...
In the DataCatalog, all file names are of the form r<run#>.
Naming examples:
Data/Flight/Reprocess/P106-LEO:MERIT r0239557414 Data/Flight/Reprocess/P106-LEO:FT1 r0239557414
Data Sample
The currently defined data sample for P110 and P110-LEO reprocessing includes:
|
P106-LEO |
---|---|
First run |
237928185 (2008-07-16 19:09:45 UTC) |
Last run |
244406327 (2008-09-29 18:38:47 UTC) |
Total runs |
199 |
Total MERIT events |
484,421,935 |
Total FT1 events |
138,013,907 |
Note that the L&EO data represent a discontiguous set of runs.
===========================================================================
Bookkeeping
- (This page): Define ingredients of reprocessing (processing code/configuration changes)
- Processing History database: http://glast-ground.slac.stanford.edu/HistoryProcessing/HProcessingRuns.jsp?processingname=P106-LEO
- List of all reprocessings
- List of all data runs reprocessed
- Pointers to all input data files (-> dataCatalog)
- Pointers to associated task processes (-> Pipeline II status)
- Data Catalog database: http://glast-ground.slac.stanford.edu/DataCatalog/folder.jsp
- Lists of and pointers to all output data files
- Meta data associated with each output data product
P106-LEO-MERIT
Status chronology
- 11 May 2010 - Prepare task
Configuration
The configuration for this reprocessing is nearly the same as for the ordinary science data with three exceptions: the run list was provided by Anders (and consists of a discontiguous set of runs); fewer data products are produced; and, the algorithm for finding FT2 files was modified to accommodate these earlier data (in fact, Warren produced a new set of 1-second FT2 files specifically for this reprocessing project). Note that the original list of runs counted 200, but a single run proved troublesome, 238781852, and was removed from the list, leaving 199 runs to reprocess.
Task Location |
/nfs/farm/g/glast/u38/Reprocess-tasks/P106-LEO-MERIT |
Task Status |
http://glast-ground.slac.stanford.edu/Pipeline-II/index.jsp |
GlastRelease |
v17r47p12gr10 |
Input Data Selection |
??????? "standard" from https://confluence.slac.stanford.edu/display/SCIGRPS/LAT+Dataset+Definitionsalong with "&& (RunQuality != "Bad" || is_null ( RunQuality )" |
Input Run List |
ftp://ftp-glast.slac.stanford.edu/glast.u38/Reprocess-tasks/P106-LEO-MERIT/config/runFile.txt |
ScienceTools |
v9r15p5 |
EvtClassDefs |
00-14-00 |
Evt Classifier |
Pass6_Reprocessing_Classifier |
photonFilter |
PASS6_FSW_CUTS = (FswGamState==0||FswGamState==3) && (CTBCORE>0) && (CTBBestEnergyProb>0) && (CTBBestEnergy>10) && (CTBBestEnergyRatio<5) && (CTBClassLevel>0) |
IRFs |
P6_V3_DIFFUSE |
jobOpts |
ftp://ftp-glast.slac.stanford.edu/glast.u38/Reprocess-tasks/P106-LEO-MERIT/config/doRecon.txt |
Output Data Products |
Other configurations.
ROOT version |
v5.20.00-gl5 |
Skimmer version |
v7r3p3-gl2 |