P130 Reprocessing
status: In Progress Complete
last update: 2 18 April 2012
| Wiki Markup |
|---|
This page is a record of the configuration for the P130 reprocessing project, recalculating the diffuse response (see [here|https://confluence.slac.stanford.edu/download/attachments/112105781/DiffResp_Fegan_Nov2011.pdf?version=1&modificationDate=1320928938000] for a description of the change). This task is identical with P120-FT1, v2.1 \[[please see|~dragon:P120 reprocessing] for details\], run in July 2011, except for the following details. |
- New version of ScienceTools (09-26-02) which includes new integration scheme for gtdiffrsp
- New run list (updated for data processed since the end of P120)
- Name of Pipeline task (P120->P130) as well as in file naming
Data Sample
=============== THIS SECTION NEEDS TO BE UPDATED FOR P130 FINAL STATISTICS ====================
The currently defined data sample for P120 P130 reprocessing includes: |
First run |
...
239557414 (MET), 2008-08-04 15:43:34 (UTC) |
...
beginning of Science |
...
...
Last run |
...
356429251 (MET), 2012-04-18 08:07:29 (UTC) |
...
| |
Total runs |
...
20,385 |
...
|
...
Total input MERIT events |
...
44,398,334,636 |
...
all "events" |
...
...
Total disk space used |
...
33.9 TB |
...
|
Summary from DataCatalog as of 4/17/2012. ||
Name |
|---|
...
Files |
|---|
...
Events |
|---|
...
Size | |||
|---|---|---|---|
FT1 | 20385 | 184,008,254 | 16.6 GB |
LS1 | 20385 | 1,295,164,924 | 210.5 GB |
ELECTRONFT1 | 20385 | 85,057,599 | 8.0 GB |
EXTENDEDFT1 | 20385 | 11,240,869,507 | 984.6 GB |
EXTENDEDLS1 | 20385 | 11,240,869,507 | 1.8 TB |
Bookkeeping
- (This page): Define ingredients of reprocessing (processing code/configuration changes)
- Processing History database: http://glast-ground.slac.stanford.edu/HistoryProcessing/HProcessingRuns.jsp?processingname=P130
- List of all reprocessings
- List of all data runs reprocessed
- Pointers to all input data files (-> dataCatalog)
- Pointers to associated task processes (-> Pipeline II status)
- Data Catalog database: http://glast-ground.slac.stanford.edu/DataCatalog/folder.jsp
- Lists of and pointers to all output data files
- Meta data associated with each output data product
...
- 2/3/2012 - Block 1 reprocessing complete
- 4/2/2012 - Begin block 2, raising the total # runs to 20126, through run 354926369 2012-03-31 22:39:29 (UTC)
- 4/17/2012 - Final reprocessing block: additional 259 runs through 356429251, 2012-04-18 08:07:29 (UTC)
- 4/18/2012 - Complete.
Configuration
Task Location | /nfs/farm/g/glast/u38/Reprocess-tasks/P130-FT1 |
Task Status | http://glast-ground.slac.stanford.edu/Pipeline-II/task.jsp?task=74765664 |
Input Data | MERIT from P120-MERIT (runs 239557414 - 333880535) and Level 1 (runs 333886531 - present) |
spacecraft data | FT2 from P105 (runs 239557414 - 271844560), then from current Level 1 production |
Input Run List | ftp://ftp-glast.slac.stanford.edu/glast.u38/Reprocess-tasks/P130-FT1/config/runFile.txt |
Reprocessing Mode | reFT1 |
meritFilter | FT1EventClass!=0 |
evtClassDefs | 00-19-01 |
eventClassMap | EvtClassDefs_P7V6.xml |
ScienceTools | 09-26-02 |
Code Variants | redhat5-i686-32bit-gcc41 (Optimized) |
Diffuse Model | based on contents of /afs/slac.stanford.edu/g/glast/ground/GLAST_EXT/diffuseModels/v2r0 ) |
Diffuse Response | 'source' using P7SOURCE_V6 IRF |
IRFs | P7V6, contained within ScienceTools release |
Output Data Products |
...