Versions Compared

Old Version 61

changes.mady.by.user Tom Glanzman

Saved on

compared with

New Version Current

changes.mady.by.user Tom Glanzman

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

status: Running Complete
last update: 13 May 26 June 2014

This page is a record of the configuration and execution of the P300 reprocessing project, full reprocessing from DIGIs using Pass8 analysis code.

...

  • 4/8/2015 - Setup Block 5, data from 1 Feb 2015 through 7 Apr 2015 penultimatebackfill
    • Last run Block 4 = 444436565  2015-01-31 22:36:02
    • First run Block 5 = 444442524  2015-02-01 00:15:21
    • Last run Block 5 = 450142738  2015-04-07 23:38:55
    • Total number of P300-ROOT runs = 37023
    • Number of additional runs in block 5 = 1003

  • 4/16/2015 - Block 5 complete.  Summary from dataCatalog:
     

    NameFilesEventsSizeCreated (UTC)
    GCR3702380,323,456,0121.4 TB09-May-2013 22:22:18
    MERIT3702380,323,456,012134.4 TB09-May-2013 22:22:18
    RECON3702380,323,456,0121.1 PB09-May-2013 22:22:20
    RELATION3702380,323,456,01210.5 TB09-May-2013 22:22:20
  • 6/4/2015 - Setup and start Block 6, through 6/3/2015

    • Last run of Block 5: 450142738 (2015-04-07 23:38:55)
      First run of Block 6: 450148449 (2015-04-08 01:14:06)
      Last run of Block 6: 455062807 (2015-06-03 22:20:04)

      Total runs in combined runList = 37888 (formerly 37023)
      Total new runs in Block 6 = 865

  • 6/10/2015 - Block 6 complete.  Summary from dataCatalog:

    NameFilesEventsSizeCreated (UTC)
    GCR3788882,148,825,6061.4 TB09-May-2013 22:22:18
    RELATION3788882,148,825,60610.8 TB09-May-2013 22:22:20
    MERIT3788882,148,825,606137.4 TB09-May-2013 22:22:18
    RECON3788882,148,825,6061.1 PB09-May-2013 22:22:20
  • 6/24/2015 - Setup and start Block 7, the final block of P300 reprocessing:
    • Last run of Block 6: 455062807 (2015-06-03 22:20:04)
    • First run of Block 7: 455069221 (2015-06-04 00:06:58)
    • Last run of Block 7: 456829490 (2015-06-24 09:04:47)
    • First run of Level 1: 456835199 (2015-06-24 10:39:56)
      Total runs in full reprocessing task =  38198
      Total new runs in Block 7 = 310

  • 6/26/2015 - Block 7 – and entire task – COMPLETE

    NameFilesEventsSizeCreated (UTC)
    GCR3819882,812,280,3091.5 TB09-May-2013 22:22:18
    MERIT3819882,812,280,309138.5 TB09-May-2013 22:22:18
    RECON3819882,812,280,3091.1 PB09-May-2013 22:22:20
    RELATION3819882,812,280,30910.8 TB09-May-2013 22:22:20


  • 8/2/2015 Emergency reprocess of 40 runs that were Level 1 processed with bad CAL calibrations

    Former (block7) run consisted of 38198 runs.
    New (block8) run consists of 38238 runs.
    There are 40 new runs to reprocess.
    First new run 459716687
    Last new run 459941302
    Starting point of pipeline task P300-ROOT (v1.1): 11269

Configuration

Task Location

/nfs/farm/g/glast/u38/Reprocess-tasks/P300-ROOT

Task Version1.0 (streams 0-26928), 1.1 (streams 26929-end)

Task Status

http://glast-ground.slac.stanford.edu/Pipeline-II/index.jsp

GlastRelease

20-09-00 streams 0 - 5970 (02 Jul 2013)
20-09-02 streams 5971 - end (31 Jul 2013)

Run Selection

based on a modified "standard" selection, see https://confluence.slac.stanford.edu/display/SCIGRPS/Official+LAT+Datasets
(((sIntent=="nomSciOps" || sIntent=="nomSO_noSk_noCno_optGccc_allEna" || sIntent=="nomSciOps_diagEna" || (sIntent=="nomSciOps_Emin5MeV"&&RunMin>242070455) || nRun==242429468 ) && (RunQuality != "Bad" || is_null ( RunQuality ) ) ) || sIntent=="nadirOps" )

s/c data

P202 FT2SECONDS which will eventually become a "standard" Public Release https://confluence.slac.stanford.edu/display/SCIGRPS/Official+LAT+Datasets

Input Run List

ftp://ftp-glast.slac.stanford.edu/glast.u38/Reprocess-tasks/P300-ROOT/config/runList.txt

photonFilter

Not yet applicable, although this is defined by default:  CTBParticleType==1 && ((FT1EventClass & 0x00003EFF)!=0)
pass7.6_Extended_cuts_L1 in evtClassDefs

NOTE: task P301-MERIT regenerates MERIT files from P300 MERIT files using TMineExt, updating the event classification data

electronFilter

Not yet applicable, although this is defined by default:  CTBParticleType==1

Code Variants

redhat5-i686-32bit-gcc41 (Optimized), note that rhel5-64 and rhel6-64 GR builds are not yet available

jobOpts

ftp://ftp-glast.slac.stanford.edu/glast.u38/Reprocess-tasks/P300-ROOT/config/Pass8Recon.txt

calibrations & alignments

"p7repro" and "L1current" (the latter to conform with new Level 1 flavor, and to include new ACD calibration for 9 Sep 2012)

Output Data Products

RECON, GCR, RELATION, MERIT, FILTEREDMERIT, ELECTRONMERIT (but note that FILTEREDMERIT and ELECTRONMERIT are empty or contain junk)

...