Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

This page is a record of the configuration for the P200 reprocessing project, full reprocessing from DIGIs using Pass7 code. This project involves reprocessing with Pass7 classification trees and new IRFs. The name "P200" derives from the word "processing" and the initial file version to be used for the output data products, e.g., r0123456789_v200_merit.root.

"Old style" tasks (using CMT, heritage scripts, etc.)
  • P200-ROOT - this This task reads DIGI and produces reprocessed RECON+CAL+GCR+MERIT+FILTEREDMERIT (photons)+ELECTRONMERIT
  • P200-FITS - This task reads MERIT and produces FT1 (photons) + EXTENDEDFT1 + LS1 (merit-like FITS file for photons) + EXTENDEDLS1 + ELECTRONFITS file
"New style" tasks (using SCons, OO and common scripts, etc.)
  • P201-ROOT - This task reads DIGI and produces reprocessed RECON+CAL+GCR+MERIT+FILTEREDMERIT (photons)+ELECTRONMERIT
  • P201-FITS - This task reads MERIT and produces FT1 (photons) + EXTENDEDFT1 + LS1 (merit-like FITS file for photons) + EXTENDEDLS1 + ELECTRONFITS file

    Datafile names, versions and locations

Data file version numbers for this reprocessing will begin with v200.

...

Note: 'procVer' is a field added to the file name (and the keyword "PROC_VER" in the primary header) added to the FFD 5/12/2010. Ref: http://fermi.gsfc.nasa.gov/ssc/dev/current_documents/Science_DP_FFD_RevA.pdfImage Removed

Examples:

Code Block
/glast/Data/Flight/Reprocess/P200/recon/r0239557414_v120_recon.root
/glast/Data/Flight/Reprocess/P200/cal/r0239557414_v120_cal.root
/glast/Data/Flight/Reprocess/P200/gcr/r0239557414_v120_gcr.root
/glast/Data/Flight/Reprocess/P200/merit/r0239557414_v120_merit.root
/glast/Data/Flight/Reprocess/P200/filteredmerit/r0239557414_v120_filteredmerit.root
/glast/Data/Flight/Reprocess/P200/electronmerit/r0239557414_v120_electronmerit.root
/glast/Data/Flight/Reprocess/P200/extendedft1/gll_xp_p120_r0239559565_v120.fit
/glast/Data/Flight/Reprocess/P200/ft1/gll_ph_p120_r0239559565_v120.fit
/glast/Data/Flight/Reprocess/P200/electronft1/gll_el_p120_r0239559565_v120.fit
/glast/Data/Flight/Reprocess/P200/extendedls1/gll_xe_p120_r0239559565_v120.fit
/glast/Data/Flight/Reprocess/P200/ls1/gll_ev_p120_r0239559565_v120.fit

...

NOTE: One run, 242429468, of type TrigTest was declared 'good for science' but long after this task got started, so it has been intentionally omitted.unmigrated-wiki-markup

\[to be continued...\]

Bookkeeping

  1. (This page): Define ingredients of reprocessing (processing code/configuration changes)
  2. Processing History database: http://glast-ground.slac.stanford.edu/HistoryProcessing/HProcessingRuns.jsp?processingname=P200Image Removed
    1. List of all reprocessings
    2. List of all data runs reprocessed
    3. Pointers to all input data files (-> dataCatalog)
    4. Pointers to associated task processes (-> Pipeline II status)
  3. Data Catalog database: http://glast-ground.slac.stanford.edu/DataCatalog/folder.jspImage Removed
    1. Lists of and pointers to all output data files
    2. Meta data associated with each output data product

...

Task Location

/nfs/farm/g/glast/u38/Reprocess-tasks/P200-MERIT

Task Status

http://glast-ground.slac.stanford.edu/Pipeline-II/index.jspImage Removed

GlastRelease

v17r35p23 (CMT)

Input Data Selection

"standard" from

https://confluence.slac.stanford.edu/display/SCIGRPS/LAT+Dataset+DefinitionsImage Removed

along with "&& (RunQuality != "Bad" || is_null ( RunQuality )"

s/c data

"standard" (FT2 from P105 (runs 239557414 - 271844560), then from current Level 1 production)

Input Run List

ftp://ftp-glast.slac.stanford.edu/glast.u38/Reprocess-tasks/P200-MERIT/config/runFile.txtImage Removed

photonFilter

CTBParticleType==0 && CTBClassLevel>0

electronFilter

CTBParticleType==1

jobOpts

ftp://ftp-glast.slac.stanford.edu/glast.u38/Reprocess-tasks/P200-MERIT/config/doRecon.txtImage Removed

Output Data Products

MERIT, FILTEREDMERIT, ELECTRONMERIT

...

Task Location

/nfs/farm/g/glast/u38/Reprocess-tasks/P200-FT1

Task Status

http://glast-ground.slac.stanford.edu/Pipeline-II/task.jsp?task=63390236Image Removed

Input Data

MERIT (from P200-MERIT)

spacecraft data

FT2 from P105 (runs 239557414 - 271844560), then from current Level 1 production

Input Run List

ftp://ftp-glast.slac.stanford.edu/glast.u38/Reprocess-tasks/P200-FT1/config/runFile.txtImage Removed

Reprocessing Mode

reFT1

meritFilter

FT1EventClass!=0

evtClassDefs

00-19-01

eventClassMap

EvtClassDefs_P7V6.xml

ScienceTools

09-24-00

Code Variants

redhat5-i686-32bit-gcc41 (Optimized)

Diffuse Model

based on contents of /afs/slac.stanford.edu/g/glast/ground/GLAST_EXT/diffuseModels/v2r0
(see

https://confluence.slac.stanford.edu/display/SCIGRPS/Quick+Start+with+Pass+7Image Removed

)

Diffuse Response

'source' using P7SOURCE_V6 IRF
'clean' using P7CLEAN_V6 IRF

IRFs

P6V7, contained within ScienceTools release

Output Data Products

FT1, LS1, EXTENDEDFT1, EXTENDEDLS1, ELECTRONFT1

...