Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Location template:

Code Block

/glast/Data/Flight/Reprocess/<reprocessName>/<dataType>

Locations for P300:

Code Block

/glast/Data/Flight/Reprocess/P300/recon
/glast/Data/Flight/Reprocess/P300/gcr
/glast/Data/Flight/Reprocess/P300/relation/glast/Data/Flight/Reprocess/P300/merit
/glast/Data/Flight/Reprocess/P300/filteredmerit
/glast/Data/Flight/Reprocess/P300/electronmerit
/glast/Data/Flight/Reprocess/P300/ft1
/glast/Data/Flight/Reprocess/P300/extendedft1
/glast/Data/Flight/Reprocess/P300/electronft1
/glast/Data/Flight/Reprocess/P300/ls1
/glast/Data/Flight/Reprocess/P300/extendedls1

...

Note: 'procVer' is a field added to the file name (and the keyword "PROC_VER" in the primary header) added to the FFD 5/12/2010. Ref: http://fermi.gsfc.nasa.gov/ssc/dev/current_documents/Science_DP_FFD_RevA.pdf

Example:

Code Block

/glast/Data/Flight/Reprocess/P300/recon/r0239557414_v202_recon.root

...

Logical directory and group template:

Code Block

Data/Flight/Reprocess/<reprocessName>:<dataType>

...

Naming examples:

Code Block

Data/Flight/Reprocess/P300:RECON r0239557414

...

  • Current performance results for the Pass8 code are on this page .
  • For 20,000 event clumps:

    job step

    average CPU time

    processClump

    183 min

    mergeClumps

    10 min

  • Plot of job throughput as of 20130813

    From the plot, one can see a processing rate of ~208 runs/day. Assuming 28500 total runs, this would mean a repro time of 137 days or 4.5 months.
  • Another plot showing the number of run scratch directories cleaned up per day:

...

  • 8/1/2013 - Initial P300x-FITS task created. 10 trial runs processed. (See caveats above.)
  • 8/7/2013 - First year of data run through the task, amounting to 5537 runs and 11790391606 events:

    First run

    239557417

    2008-08-04 15:43:37

    Last run

    271850279

    2009-08-13 09:57:59

  • 8/28/2013 - Second year of data ready and processed -> extendedFT1. Note that 36 troublesome runs omitted from 1st year data were included in this sample. There should be no missing runs in this sample.

    First run

    239557417

    2008-04-2008 15:43:37

    Last run

    302647722

    2010-08-04 20:48:40

    10,976 runs, 2,677,747,829 events, 234.7 GB

  • 9/25/2013 - Third year of data ready.

    First run

    239557417

    2008-04-2008 15:43:37

    Last run

    334184989

    2011-08-04 21:09:47

    This block contains 16,516 runs and 36,056,385,847 events, or an increase over year 2 of 5,540 runs.

Configuration

CAUTION: The following data describes the experimental P300x-FITS task, not the production task

Task Location

/nfs/farm/g/glast/u38/Reprocess-tasks/P300x-FITS

Task Status

http://glast-ground.slac.stanford.edu/Pipeline-II/exp/Fermi/task.jsp?task=112641219

Input Data

MERIT (direct from P300-ROOT)

spacecraft data

same as P300-ROOT

Input Run List

ftp://ftp-glast.slac.stanford.edu/glast.u38/Reprocess-tasks/P300x-FITS/config/runList.txt

evtClassDefs

untagged version from 20130801

eventClassMap

EvtClassDefs_P8.xml

ScienceTools

09-32-05 (7/30/2013)

Code Variants

redhat5-x86_64-64bit-gcc41 & redhat6-x86_64-64bit-gcc44   (Optimized)

Diffuse Model

based on contents of /afs/slac.stanford.edu/g/glast/ground/GLAST_EXT/diffuseModels/v2r0 /v3r0
(see https://confluence.slac.stanford.edu/display/SCIGRPS/Quick+Start+with+Pass+7)

Diffuse Response

N/A

IRFs

N/A

Output Data Products

EXTENDEDFT1

...