Versions Compared

Old Version 23

changes.mady.by.user Tom Glanzman

Saved on

compared with

New Version Current

changes.mady.by.user Tom Glanzman

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

status: Complete
last update: 18 30 November 2010

This page is a record of the configuration for the P116 reprocessing project, rebuilding FT1 files (and friends) for all of science data with new, extended event classifications.

...

Note: 'procVer' is a field added to the file name (and the keyword "PROC_VER" in the primary header) added to the FFD 5/12/2010. Ref: http://fermi.gsfc.nasa.gov/ssc/dev/current_documents/Science_DP_ICD_RevA.pdfImage Removed

Example:

Code Block
/glast/Data/Flight/Reprocess/P116/ft1/gll_ph_p116_r0239559565_v116.fit
/glast/Data/Flight/Reprocess/P116/ls1/gll_ev_p116_r0239559565_v116.fit

...

These data are destined for the FSSC and were made public as of 17 November 2010
These data (along with subsequent Level 1 data) are in the SLAC Astroserver as P6_public_v2.

...



Three extra runs were unintentionally processed as part of P116:

...

The first of these was deemed good for science, while the last two were not. Therefore, runs 250687192 and 250692922 have been retroactively removed from the datacatlog, astroserver and FSSC. (Removed from dataCatalog on 2/22/2011.)

Bookkeeping

  1. (This page): Define ingredients of reprocessing (processing code/configuration changes)
  2. Processing History database: http://glast-ground.slac.stanford.edu/HistoryProcessing/HProcessingRuns.jsp?processingname=P116Image Removed
    1. List of all reprocessings
    2. List of all data runs reprocessed
    3. Pointers to all input data files (-> dataCatalog)
    4. Pointers to associated task processes (-> Pipeline II status)
  3. Data Catalog database: http://glast-ground.slac.stanford.edu/DataCatalog/folder.jspImage Removed
    1. Lists of and pointers to all output data files
    2. Meta data associated with each output data product

...

(This task is roughly equivalent to the P105-FT1 task but with updates and modernization.)

Status chronology

  • 11/29/2010 - Run 245403855 start time modified in datacatalog (1 second earlier), regenerate runFile.txt, and rollback stream 1019 to make astroserver happy. This adds three (3) events to that run. (Statistics above not updated)
  • 11/17/2010 - reprocess final backfill block3 (98 runs)
  • 11/12/2010 - discover that gtdiffrsp params were incorrect (evtclass parm ignored, so all events got all diff rsp calc). Next (last) backfill block will be corrected.
  • 11/11/2010 - gear up for reprocessing data block2 (617 runs)
  • 10/18/2010 - 146 mergeClumps jobs ran out of CPU time. Changed to xxl batch queue and rolled back.
  • 10/14/2010 - Validation complete, begin production for data block1
  • 10/1/2010 - Begin task construction

...

Task Location

/nfs/farm/g/glast/u38/Reprocess-tasks/P116-FT1

Task Status

P116-FT1

Input Data Selection

MERIT

Input Run List

http://glast-ground.slac.stanford.edu/Decorator/Decorate/u38/Reprocess-tasks/P116-FT1/config/runFile.txtImage Removed

Reprocessing Mode

reFT1

evtClassDefs

00-18-00

photon cut

pass6_FSW_cuts

eventClassifier

dataclean_classifier.py

eventClassMap

n/a

s/c data

FT2 from P105 (runs 239557414 - 271844560), then from current Level 1 production

ScienceTools

09-18-05 (SCons build)

Allowed Code Variants

redhat4-i686-32bit-gcc34, redhat4-x86_64-64bit-gcc34,
redhat5-i686-32bit-gcc41, redhat5-x86_64-64bit-gcc41 (Optimized)

Diffuse Model

/afs/slac.stanford.edu/g/glast/ground/releases/analysisFiles/diffuse/v2/source_model_v02.xml
(

https://confluence.slac.stanford.edu/display/SCIGRPS/Diffuse+Model+for+Analysis+of+LAT+DataImage Removed

)

Diffuse Response IRFs

P6_V3_DIFFUSE, P6_V3_DATACLEAN

Output Data Products

FT1, LS1

...