You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 75 Next »

status: Complete through 31 July 2012
last update: 25 Aug 2012

This page is a record of the configuration and execution of the P202 reprocessing project, full reprocessing from DIGIs using Pass7 analysis code. This project involves reprocessing with Pass7 classification trees and up-to-date alignment/calibration data. This task will read DIGI files and emit RECON, MERIT, GCR and CAL ROOT files, and the standard array of FITS files. It will be a CPU-intensive and storage-intensive enterprise requiring months of elapsed time and of order 0.7 Pbyte of storage. At the time of this task beginning, there will be about 20,000 science runs in Fermi (3.5 years accumulation).

To avoid occupying a new 0.7 PB of disk space, the plan is to remove old RECON files once they have been reprocessed. This is a shell game that involves some amount of buffer space and then waiting until the new RECON file has been created and (to some extent) validated before removal. The old RECON files will be retained on tape in the HPSS system and they will be available via xroot (but with some delay as these large files are staged in). In addition, old CAL files will be removed from disk without being stored on tape.

The name "P202" derives from the word "processing" and the initial file version to be used for the output data products, e.g., r0123456789_v202_merit.root.

"New generation" tasks (using SCons builds, rewritten task scripts, common python scripts, etc.)
  • P202-ROOT - This task reads DIGI and produces reprocessed RECON + CAL + GCR + MERIT + FILTEREDMERIT (photons) + ELECTRONMERIT
  • P202-FITS - This task reads MERIT and produces FT1 (photons) + EXTENDEDFT1 + LS1 (merit-like FITS file for photons) + EXTENDEDLS1 + ELECTRONFITS file
  • P202-LEO-ROOT - This task performs the same function as P202-ROOT, but with the 200 L&EO data taken summer 2008.

Datafile names, versions and locations

Data file version numbers for this reprocessing will begin with v202.

XROOT location and file naming

Location template:

/glast/Data/Flight/Reprocess/<reprocessName>/<dataType>

Locations for P202:

/glast/Data/Flight/Reprocess/P202/recon
/glast/Data/Flight/Reprocess/P202/cal
/glast/Data/Flight/Reprocess/P202/gcr
/glast/Data/Flight/Reprocess/P202/merit
/glast/Data/Flight/Reprocess/P202/filteredmerit
/glast/Data/Flight/Reprocess/P202/electronmerit
/glast/Data/Flight/Reprocess/P202/ft1
/glast/Data/Flight/Reprocess/P202/extendedft1
/glast/Data/Flight/Reprocess/P202/electronft1
/glast/Data/Flight/Reprocess/P202/ls1
/glast/Data/Flight/Reprocess/P202/extendedls1

File naming:

Data Type

aka

Send to FSSC

Naming template

RECON

 

No

r<run#>_<version>_<dataType>.root

CAL

 

No

r<run#>_<version>_<dataType>.root

GCR

 

No

r<run#>_<version>_<dataType>.root

MERIT

 

No

r<run#>_<version>_<dataType>.root

FILTEREDMERIT

 

No

r<run#>_<version>_<dataType>.root

ELECTRONMERIT

 

No

r<run#>_<version>_<dataType>.root

ELECTRONFT1

 

No

gll_el_p<procVer>_r<run#>_<version>.fit

EXTENDEDFT1

 

No

gll_xp_p<procVer>_r<run#>_<version>.fit

FT1

LS-002

Yes

gll_ph_p<procVer>_r<run#>_<version>.fit

EXTENDEDLS1

 

No

gll_xe_p<procVer>_r<run#>_<version>.fit

LS1

LS-001

Yes

gll_ev_p<procVer>_r<run#>_<version>.fit

Note: 'procVer' is a field added to the file name (and the keyword "PROC_VER" in the primary header) added to the FFD 5/12/2010. Ref: http://fermi.gsfc.nasa.gov/ssc/dev/current_documents/Science_DP_FFD_RevA.pdf

Examples:

/glast/Data/Flight/Reprocess/P200/recon/r0239557414_v202_recon.root
/glast/Data/Flight/Reprocess/P200/cal/r0239557414_v202_cal.root
/glast/Data/Flight/Reprocess/P200/gcr/r0239557414_v202_gcr.root
/glast/Data/Flight/Reprocess/P200/merit/r0239557414_v202_merit.root
/glast/Data/Flight/Reprocess/P200/filteredmerit/r0239557414_v202_filteredmerit.root
/glast/Data/Flight/Reprocess/P200/electronmerit/r0239557414_v202_electronmerit.root
/glast/Data/Flight/Reprocess/P200/extendedft1/gll_xp_p202_r0239559565_v202.fit
/glast/Data/Flight/Reprocess/P200/ft1/gll_ph_p202_r0239559565_v202.fit
/glast/Data/Flight/Reprocess/P200/electronft1/gll_el_p202_r0239559565_v202.fit
/glast/Data/Flight/Reprocess/P200/extendedls1/gll_xe_p202_r0239559565_v202.fit
/glast/Data/Flight/Reprocess/P200/ls1/gll_ev_p202_r0239559565_v202.fit
DataCatalog location and naming

Logical directory and group template:

Data/Flight/Reprocess/<reprocessName>:<dataType>

Note that the <dataType> field (following the colon) is a DataCatalog 'group' name, and file names are of the form r<run#>.

Naming examples:

Data/Flight/Reprocess/P202:RECON r0239557414
Data/Flight/Reprocess/P202:CAL r0239557414
Data/Flight/Reprocess/P202:GCR r0239557414
Data/Flight/Reprocess/P202:MERIT r0239557414
Data/Flight/Reprocess/P202:FILTEREDMERIT r0239557414
Data/Flight/Reprocess/P202:EXTENDEDFT1 r0239557414
Data/Flight/Reprocess/P202:FT1 r0239557414
Data/Flight/Reprocess/P202:ELECTRONFT1 r0239557414
Data/Flight/Reprocess/P202:EXTENDEDLS1 r0239557414
Data/Flight/Reprocess/P202:LS1 r0239557414

Data Sample

The currently defined data sample for P202 reprocessing includes:

First run

239557414 (MET), 2008-08-04 15:43:34 (UTC)

Last run

354923690 (MET), 2012-03-31 21:54:48 (UTC)

Total runs

20,229

Total input DIGI events

44,125,679,961

 

Total RECON events

44,125,679,961

 

Total CAL events

44,125,679,961

 

Total GCR events

44,125,679,961

 

Total MERIT events

44,125,679,961

all "events"

Total FILTEREDMERIT events

6,291,424,926

selected photon event classes

Total ELECTRONMERIT events

90,904,582

all electron events

Generation of FITS files is a second step in the reprocessing and has only been run on the first year of data. Stay tuned...

Total EXTENDEDFT1/LS1 events

6,291,424,926

selected photon event classes

Total LS1 (FSSC selection) events

1,325,204,821

event classes (bits) 0,2,3,4 (transient, source, clean, ultraclean)

Total FT1 (FSSC selection) events

189,323,074

event classes (bits) 2,3,4 (source, clean, ultraclean)

Total disk space used

762.4 TB

 

Total effective disk footprint

43.7 TB

after removal of old RECON and CAL files

NOTE: One run, 242429468, of type TrigTest was declared 'good for science' and has been included.

Bookkeeping

  1. (This page): Define ingredients of reprocessing (processing code/configuration changes)
  2. Processing History database: http://glast-ground.slac.stanford.edu/HistoryProcessing/HProcessingRuns.jsp?processingname=P202
    1. List of all reprocessings
    2. List of all data runs reprocessed
    3. Pointers to all input data files (-> dataCatalog)
    4. Pointers to associated task processes (-> Pipeline II status)
  3. Data Catalog database: http://glast-ground.slac.stanford.edu/DataCatalog/folder.jsp
    1. Lists of and pointers to all output data files
    2. Meta data associated with each output data product

P202-ROOT

Status chronology

  • 2/13/2012 - begin trials with final calibration and alignments from Leon; 5 runs reprocessed
  • 2/14/2012 - trials continue with blocks of 15, 20, 25 and 50 runs reprocessed (each run generates ~20 batch jobs)
  • 2/16/2012 - begin trickleStream production. Initial config: 
    ===============================================================================
  TRICKLE PARMS
===============================================================================
task =  P202-ROOT
maxRuns =  19172
firstStep =  setupRun
steps =  [['/processRun processClump', 1500, 20], ['mergeClumps', 70, 1]]
maxStreamsPerCycle =  20
timePerCycle =  300
===============================================================================
  • 2/21/2012 - One clump reprocessed with pointer to new mySQL DB (stream 710.0)
  • 2/22/2012 - 776 runs complete. Pausing task.

    S/W component

    modification

    status

    FILTEREDMERIT TCut

    CTBClassLevel>0 changed to ((FT1EventClass & 0x00003EFF)!=0)

    done 3/14/2012

  • 3/15/2012 - resume task. New goal is 1-year of data (~5600 runs)
  • 3/31/2012 - 1-year complete (5600 runs). There have been a few nasty problems which need to be fixed before continuing.

    S/W component

    bug fix

    status

    New ROOT version

    5-min 'transaction timeout' triggered by xroot data server reboot

    done 4/3/2012

    New GlastRelease

    1) include new ROOT version (above); 2) exit with non-zero RC on ROOT write error

    done 4/5/2012, GR 17-35-24-rp04 (or -rp07)

    New GPL_TOOLS(question)

    check size/checksum of file written to xroot with known size/checksum

    pending

    Tuned xroot on new Dell servers

    silent file truncation when volume fills up JIRA

    done 4/4/2012 (100 MB min space limit -> 100 GB; file system space check cadence changed from 10 min to 2 min)

    New xroot client tools

    complain when xroot data server fails on write

    done 4/3/2012, v3.1.1

    New TSkim

    1) new ROOT version (above); 2) complain on ROOT write errors

    done 4/5/2012, v08-02-01

    New xroot redirector

    required step toward enabling HPSS staging

    done 4/3/2012, v3.1.1

    Note also that the FILTEREDMERIT files contain 42 more events than the EXTENDEDFT1 files; they should be identical.
  • 4/5/2012 - resume task. New goal is entire science dataset.
  • 4/10/2012 - Unknown 'glitch' may have caused a few 100's of jobs to crash and take sulky46 along with them.
  • 4/11/2012 - due to possible overload of sulky46/u18 writing a lot of core files, have introduced one change to processClumps.py: prepend "ulimit -c 0;" to gleam command to disable all core file generation. This starts approx with run 7605 (+/-).
  • 4/12/2012 - 10:40pm lightening strikes SLAC power lines. Site-wide power outage. Stream 7795 was the last stream submitted prior to the outage.
  • 4/15/2012 - Batch farm back in operation, resume task...
  • 5/9/2012 - major pipeline issue...shut down pipeline and allow to drain (due to tomorrow's major outage)
  • 5/10/2012 - 13:40 outage over.
    • Update GR from 17-35-24-rp04 to 17-35-24-rp07 in which the only change is replacing the 5-minute xroot time-out with 8 hours. This change effective with stream 14314 and previously failed pieces of four other runs: 14247.6, 14273.23, 14274.8, 14231.9.
    • Leon advises that as of today, calibrations are valid only thru ~15 Dec 2011 (run 345574915) - which is somewhere around stream 18,400. He asks Sasha to produce more up-to-date calibs.
  • 5/18/2012 - all calibrations now valid through 6 May 2012. No need to pause P202 task.
  • 5/28/2012 - 15:30 Complete (through 31 March 2012)
    • Data Catalog summary:  

      Name

      Type

      Files

      Events

      Size

      Created (UTC)

      Links

      CAL

      Group

      20229

      44,125,599,595

      128.7 TB

      25-Jan-2012 00:53:31

      Files

      ELECTRONMERIT

      Group

      20229

      90,904,582

      205.7 GB

      25-Jan-2012 00:53:32

      Files

      FILTEREDMERIT

      Group

      20229

      6,291,396,710

      5.3 TB

      25-Jan-2012 00:53:29

      Files

      GCR

      Group

      20229

      44,123,014,456

      942.7 GB

      25-Jan-2012 00:53:31

      Files

      MERIT

      Group

      20229

      44,125,679,961

      35.4 TB

      25-Jan-2012 00:53:30

      Files

      RECON

      Group

      20229

      44,123,612,977

      590.0 TB

      25-Jan-2012 00:53:33

      Files

      There are discrepancies to track down!
      Turns out to be three problematic runs/streams:
      • 272707024/5723 - I/O prob, corrupt files, entire stream rolled back
      • 279108810/6847 - xroot transient access prob., re-registered in dataCat
      • 284813327/7848 - xroot transient access prob., re-registered in dataCat
  • Final trickleStream configuration: 
    ===============================================================================
  TRICKLE PARMS
===============================================================================
task =  P202-ROOT
maxRuns =  20229
firstStep =  setupRun
steps =  [['/processRun processClump', 2000, 21], ['mergeClumps', 200, 1]]
maxStreamsPerCycle =  20
timePerCycle =  300
------DEBUG----------------
maxCycles =  0
chatter =  False
dryRun =  False
===============================================================================
  • 5/31/2012 - Cleanup and summary
    • Rolling back all or part of the three runs above solved the discrepancies in # events.  New dataCatalog tally looks like this:

      Name

      Type

      Files

      Events

      Size

      Created (UTC)

      Links

      CAL

      Group

      20229

      44,125,679,961

      128.7 TB

      25-Jan-2012 00:53:31

      Files

      ELECTRONMERIT

      Group

      20229

      90,904,582

      205.7 GB

      25-Jan-2012 00:53:32

      Files

      FILTEREDMERIT

      Group

      20229

      6,291,396,711

      5.3 TB

      25-Jan-2012 00:53:29

      Files

      GCR

      Group

      20229

      44,125,679,961

      942.7 GB

      25-Jan-2012 00:53:31

      Files

      MERIT

      Group

      20229

      44,125,679,961

      35.4 TB

      25-Jan-2012 00:53:30

      Files

      RECON

      Group

      20229

      44,125,679,961

      590.0 TB

      25-Jan-2012 00:53:33

      Files
    • Total run time for 20,229 runs was ~74 days (or about 273 runs/day reprocessed). This includes periods of changing trickleStream configuration as we figured out how much load we could safely put on the system.
  • 6/5/2012 - Three streams rolled back and minor code changes for cleanup (see FITS chronology below for details)
  • 8/10/2012 - Update task for a block3 of backfill (1 Apr 2012 - 31 July 2012) and restart reprocessing.
  • 8/22/2012 - backfill complete
  • 10/6/2012 - Rollback the following seven streams to fix apparently corrupt MERIT files.

    Stream

    Run

     

    3345

    259101994

    <- found by FSSC

    4122

    263571912

     

    4707

    266893978

     

    13927

    319436826

     

    16181

    332306548

    <- found by FSSC

    17430

    339161346

     

    17479

    339408141

     
  • 10/8/2012 - Update task for block4 of backfill (1051 runs) and start reprocessing.

    First run of block 4

    365473283

    2012-08-01 00:21:20 UTC

    Last run of block 4

    371258376

    2012-10-06 23:19:33 UTC

Configuration

Task Location

/nfs/farm/g/glast/u38/Reprocess-tasks/P202-ROOT

Task Status

http://glast-ground.slac.stanford.edu/Pipeline-II/index.jsp

GlastRelease

17-35-24-gr17 and 17-35-24-rp04 (SCons RHEL4-32 build)

Run Selection

based on a modified "standard" selection, see https://confluence.slac.stanford.edu/display/SCIGRPS/Official+LAT+Datasets
(((sIntent=="nomSciOps" || sIntent=="nomSO_noSk_noCno_optGccc_allEna" || sIntent=="nomSciOps_diagEna" || (sIntent=="nomSciOps_Emin5MeV"&&RunMin>242070455) || nRun==242429468 ) && (RunQuality != "Bad" || is_null ( RunQuality ) ) ) || sIntent=="nadirOps" )

s/c data

"standard" Public Release 2 https://confluence.slac.stanford.edu/display/SCIGRPS/Official+LAT+Datasets

Input Run List

ftp://ftp-glast.slac.stanford.edu/glast.u38/Reprocess-tasks/P202-ROOT/config/runList.txt

photonFilter

CTBParticleType==1 && ((FT1EventClass & 0x00003EFF)!=0)
pass7.6_Extended_cuts_L1 in evtClassDefs

electronFilter

CTBParticleType==1

Code Variants

redhat4-i686-32bit-gcc34 (Optimized)

jobOpts

ftp://ftp-glast.slac.stanford.edu/glast.u38/Reprocess-tasks/P202-ROOT/config/doRecon.txt

Output Data Products

RECON, GCR, CAL, MERIT, FILTEREDMERIT, ELECTRONMERIT

Timing and Scaling

  • processClump
    • with 1300 jobs completed, the average time to run varies by processor type from 220 min (hequ) to 370 min (boer).
    • with nearly 10,000 runs complete, the plots appear below:
  • mergeClumps
    • with 42 jobs completed, the average time to run varies by processor type from 5-30 minutes.

Load balancing

trickleStream parameters (see above).

P202-FITS

This task generates all desired FITS data products.

Status chronology

  • 3/2/2012 - Define block 1 as the 776 runs in P202-ROOT block 1. Configure trickleStream and begin (14:08)
  • 3/31/2012 - Define block 2 as 5600 runs. Reconfig trickleStream and begin (18:05)
  • 4/01/2012 - Block 2 complete (most of the 4824 jobs completed in about six hours w/1000 job limit).
  • 5/31/2012
    • Discover stream 5599 (run 271999199) requires rollback - new MERIT file version (v203->v205).
    • Regenerate runlist with 20,229 input MERIT files.
    • Minor config change: twoClumpMin=False (formerly True, but caused unnecessary extra processClump dummy jobs)
  • 6/5/2012 - Final cleanup
    • Five runs are responsible for discrepant event tallies:

      Run

      Stream

      Reason

      Action

      239557414

      0

      bad TCut

      rollback ROOT + FITS

      241599746

      352

      bad processing order

      rollback FITS

      245403855

      1019

      bad start time

      change start time in runList and rollback

      332661583

      16244

      silent root errors

      rollback ROOT

      339081502

      17416

      silent root errors

      rollback ROOT

    • Code changes:

      directory

      script

      modification

      commonTools/00-01-00

      repTools.py

      added new getKey() function to extract #events from FITS event files

      <ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="a8e132e9-98a8-41d8-a5c4-6285cf1386e5"><ac:plain-text-body><![CDATA[

      P202-FITS/config

      config.py

      added os.environ['HEADASNOQUERY']='true' to enable 'ftlist' to run in batch

      ]]></ac:plain-text-body></ac:structured-macro>

      P202-FITS/config

      makeFITS.py

      add diagnostic print of #evts in FITS files for each processing sub-step
    • After these actions, the dataCatalog tallies are now consistent:

      Name

      Type

      Files

      Events

      Size

      Created (UTC)

      Links

      ELECTRONFT1

      Group

      20229

      0

      8.5 GB

      02-Mar-2012 00:06:07

      Files

      ELECTRONMERIT

      Group

      20229

      90,904,582

      205.7 GB

      25-Jan-2012 00:53:32

      Files

      FT1

      Group

      20229

      189,323,074

      17.8 GB

      02-Mar-2012 00:06:06

      Files

      LS1

      Group

      20229

      1,325,204,821

      215.3 GB

      02-Mar-2012 00:06:08

      Files

      EXTENDEDFT1

      Group

      20229

      6,291,424,926

      574.7 GB

      02-Mar-2012 00:06:09

      Files

      EXTENDEDLS1

      Group

      20229

      6,291,424,926

      1,020.1 GB

      02-Mar-2012 00:06:09

      Files

      FILTEREDMERIT

      Group

      20229

      6,291,424,926

      5.3 TB

      25-Jan-2012 00:53:29

      Files

      MERIT

      Group

      20229

      44,125,679,961

      35.4 TB

      25-Jan-2012 00:53:30

      Files

      RECON

      Group

      20229

      44,125,679,961

      590.0 TB

      25-Jan-2012 00:53:33

      Files

      GCR

      Group

      20229

      44,125,679,961

      942.7 GB

      25-Jan-2012 00:53:31

      Files

      CAL

      Group

      20229

      44,125,679,961

      128.7 TB

      25-Jan-2012 00:53:31

      Files

      Note that the number of events in ELECTRONFT1 files are not currently tallied by the dataCatalog.
  • 8/24/2012 - Configure and run backfill through 31 July 2012
  • 10/7/2012 - Rollback the following seven streams to fix corrupt FITS files. The makeFT1 app received a large number of ROOT error, but terminated normally. The resulting FT1/LS1 files had multiple symptoms, including one discovered by the FSSC during transfer to them: one EVENT_ID was repeated ~1000 times. Scan of log files uncovered an additional five mergeClumps with these errors.
%INFO: 20120331:20:34:32 - makeFITS(run)/line-127 - Running: makeFT1
---------------- start commentary ----------------
About to run [time makeFT1 rootFile=/scratch/glastmp/P202-FITS/3345/r0259101994_v202_merit.root fitsFile=/scratch/glastmp/P202-FITS/3345/gll_xp_p202_r0259101994_v202.fit TCuts=/afs/slac.stanford.edu/g/glast/ground/releases//volume04/evtClassDefs/00-19-04/data/pass7.6_Extended_cuts_L1 dict_file=/afs/slac.stanford.edu/g/glast/ground/releases//volume04/evtClassDefs/00-19-04/data/FT1variables tstart=259101996.933000 tstop=259106272.085000 file_version=202 tempRootFile=/scratch/glastmp/P202-FITS/3345/dummy.root xml_classifier=/afs/slac.stanford.edu/g/glast/ground/releases//volume04/evtClassDefs/00-19-04/xml/EvtClassDefs_P7V6.xml evtclsmap=FT1EventClass chatter=4 debug=yes] at Sat Mar 31 20:34:32 2012
---------------- start log ----------------
This is makeFT1 version ScienceTools-09-27-01
applying TCut: ((FT1EventClass & 0x00003EFF)!=0) && (EvtElapsedTime >= 259101996)  && (EvtElapsedTime <= 259106273)
Warning in <TClass::TClass>: no dictionary for class FileHeader is available
Warning in <TClass::TClass>: no dictionary for class RootObj<int> is available
R__unzip: error in header
Error in <TBasket::ReadBasketBuffers>: fNbytes = 15550, fKeylen = 86, fObjlen = 31912, noutot = 0, nout=0, nin=11010118, nbuf=7864444
Error in <TBranch::GetBasket>: File: /scratch/glastmp/P202-FITS/3345/r0259101994_v202_merit.root at byte:459100837, branch:Vtx2LongDoca, entry:510338, badread=0, nerrors=1, basketnumber=1
[...]

Stream

Run

 

3345

259101994

<- found by FSSC

4122

263571912

 

4707

266893978

 

13927

319436826

 

16181

332306548

<- found by FSSC

17430

339161346

 

17479

339408141

 

Configuration

Task Location

/nfs/farm/g/glast/u38/Reprocess-tasks/P202-FITS

Task Status

http://glast-ground.slac.stanford.edu/Pipeline-II/task.jsp?task=75031156

Input Data

MERIT (direct from P202-ROOT)

spacecraft data

same as P202-ROOT

Input Run List

ftp://ftp-glast.slac.stanford.edu/glast.u38/Reprocess-tasks/P202-FITS/config/runList.txt

evtClassDefs

00-19-04 (6/23/2011)

eventClassMap

EvtClassDefs_P7V6.xml

ScienceTools

09-27-01 (2/15/2012)

Code Variants

redhat5-i686-32bit-gcc41 (Optimized)

Diffuse Model

based on contents of /afs/slac.stanford.edu/g/glast/ground/GLAST_EXT/diffuseModels/v2r0
(see https://confluence.slac.stanford.edu/display/SCIGRPS/Quick+Start+with+Pass+7)

Diffuse Response

'source' using P7SOURCE_V6 IRF
'clean' using P7CLEAN_V6 IRF

IRFs

P6V7, contained within ScienceTools release

Output Data Products

FT1, LS1, EXTENDEDFT1, EXTENDEDLS1, ELECTRONFT1

Generation of output data products:

<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="48f5b7ec-f03f-4388-956c-cdc29c3bf824"><ac:plain-text-body><![CDATA[

Data Product

destination

data content [1]

event selection [1]

makeFT1

gtselect

gtdiffrsp

gtmktime

]]></ac:plain-text-body></ac:structured-macro>

EXTENDEDFT1

SLAC

FT1variables

((FT1EventClass & 0x00003EFF)!=0)
pass7.6_Extended_cuts_L1

(tick)

(error)

(tick)

(tick)

FT1

FSSC+SLAC

FT1variables

'source' and above
EVENT_CLASS bits 2,3,4
evclass=2 filtered from EXTENDEDFT1

(error)

(tick)

(inherited)

(tick)

EXTENDEDLS1

SLAC

LS1variables

((FT1EventClass & 0x00003EFF)!=0)
pass7.6_Extended_cuts_L1

(tick)

(error)

(tick)

(tick)

LS1

FSSC+SLAC

LS1variables

'transient' and above
EVENT_CLASS bits 0,2,3,4
evclass=0 filtered from EXTENDEDLS1

(error)

(tick)

(inherited)

(tick)

ELECTRONFT1

SLAC

FT1variables

CTBParticleType==1
pass7.6_Electrons_cuts_L1

(tick)

(error)

(error)

(tick)

[1] /afs/slac/g/glast/ground/releases/volume04/evtClassDefs/00-19-04/data

Note that diffuse response is calculated for 'source' and 'clean' event classes only.

Note on 'Code Variant': The SLAC batch farm contains a mixture of architectures , both hardware (Intel/AMD 64-bit) and software (RHEL5-64, gcc v4.1, etc.). At this time, GlastRelease builds only on RHEL4-32, while ScienceTools builds for RHEL5-32, RHEL5-64.

Timing

  •  

P202-LEO-ROOT

Status chronology

  • 8/8/2012 - Prepare task
  • 8/18/2012 - 200 runs complete
  • 8/25/2012 - Per Seth and Anders, add five runs and remove two:
    • Add: 238421027, 238489647, 239108423, 239114152, 239208666
    • Remove: 244395837, 244401823
      (Note that removed runs have only been removed from dataCatalog – not from xroot)
      But first, need FT2 files for these five runs!

Configuration

Identical with P202-ROOT except for the list of runs to be processed...with one exception: to reprocess the four extra (out-of-order) L&EO runs, disable the event list sort.

Timing

  • No labels