...

P118 Reprocessing

status: In preparation
last update: 15 Feb 2011

This page is a record of the configuration for the P1xx P118 reprocessing project, recalculating diffuse response with new P6_V11 IRFs and adding to existing FT1 files. This processing will be applied to all science data, be incorporated into Level 1 processing, and results sent to the FSSC.

• P1xxP118-FT1 - this task will read existing FT1 (photons) files and emit new FT1 files

Datafile names, versions and locations

Data file version numbers for this reprocessing will begin with v1xxv118.

XROOT location and file naming

Location template:

/glast/Data/Flight/Reprocess/<reprocessName>/<dataType>

Locations for P1xxP118:

/glast/Data/Flight/Reprocess/P1xxP118/ft1

File naming:

...

/glast/Data/Flight/Reprocess/P1xxP118/ft1/gll_ph_p116_r0239559565_v116.fit
/glast/Data/Flight/Reprocess/P1xxP118/ls1/gll_ev_p116_r0239559565_v116.fit

DataCatalog location and naming

Logical directory and group template:

...

Data/Flight/Reprocess/P1xxP118:FT1 r0239557414
Data/Flight/Reprocess/P1xxP118:LS1 r0239557414

Data Sample

The data sample for P1xx P118 reprocessing includes the current definition of the "Public_v2" dataset.

...

The first of these was deemed good for science, while the last two were not. Therefore, runs 250687192 and 250692922 have been retroactively removed from the datacatlog, astroserver and FSSC.

Bookkeeping

1. (This page): Define ingredients of reprocessing (processing code/configuration changes)
2. Processing History database: http://glast-ground.slac.stanford.edu/HistoryProcessing/HProcessingRuns.jsp?processingname=P1xxP118^{Image Modified}
   1. List of all reprocessings
   2. List of all data runs reprocessed
   3. Pointers to all input data files (-> dataCatalog)
   4. Pointers to associated task processes (-> Pipeline II status)
3. Data Catalog database: http://glast-ground.slac.stanford.edu/DataCatalog/folder.jsp
   1. Lists of and pointers to all output data files
   2. Meta data associated with each output data product

...

P118-FT1

Anchor

...

P118-FT1

...

P118-FT1

(This task is roughly equivalent to the P105-FT1 task but with updates and modernization.)

Status chronology

2/15/2011 - Begin configuration for this task

Configuration

Task Location	/nfs/farm/g/glast/u38/Reprocess-tasks/P1xxP118-FT1
Task Status	P1xxP118-FT1
Input Data Selection	FT1
Input Run List	http://glast-ground.slac.stanford.edu/Decorator/Decorate/u38/Reprocess-tasks/P1xxP118-FT1/config/runFile.txtImage Modified
Reprocessing Mode	reFT1
evtClassDefs	00-18-00
photon cut	pass6_FSW_cuts
eventClassifier	dataclean_classifier.py
s/c data	FT2 from P105 (runs 239557414 - 271844560), then from current Level 1 production
ScienceTools	TBD ** 09-22-00? (SCons build)
Allowed Code Variants	redhat4-i686-32bit-gcc34, redhat4-x86_64-64bit-gcc34, redhat5-i686-32bit-gcc41, redhat5-x86_64-64bit-gcc41 (Optimized)
Diffuse Model	/afs/slac.stanford.edu/g/glast/ground/releases/analysisFiles/diffuse/v2/source_model_v02.xml ( https://confluence.slac.stanford.edu/display/SCIGRPS/Diffuse+Model+for+Analysis+of+LAT+Data )
Diffuse Response IRFs	P6_V3_DIFFUSE, P6_V3_DATACLEAN
Output Data Products	FT1, LS1

...

Note on diffuse response calculation: gtdiffrsp is called two times in succession. For the bulk of this processing, the incorrect parameter was used for gtdiffrsp (IRF P6_V3_DIFFUSE and evclass==3, and IRF P6_V3_dataclean and evclass==4). After block2 this was corrected to IRF P6_V3_DIFFUSE and evclsmin==3, and IRF P6_V3_DATACLEAN and evclsmin==4. The resulting FT1 files have five columns for diffuse response of which two pairs are filled in for DATACLEAN, one pair for DIFFUSE and zero for all other events. Each pair contains galactic and extragalactic response.

Timing