Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • 3/2/2012 - Define block 1 as the 776 runs in P202-ROOT block 1. Configure trickleStream and begin (14:08)
  • 3/31/2012 - Define block 2 as 5600 runs. Reconfig trickleStream and begin (18:05)
  • 4/01/2012 - Block 2 complete (most of the 4824 jobs completed in about six hours w/1000 job limit).
  • 5/31/2012
    • Discover stream 5599 (run 271999199) requires rollback - new MERIT file version (v203->v205).
    • Regenerate runlist with 20,229 input MERIT files.
    • Minor config change: twoClumpMin=False (formerly True, but caused unnecessary extra processClump dummy jobs)
  • 6/5/2012 - Final cleanup
    • Five runs are responsible for discrepant event tallies:

      Run

      Stream

      Reason

      Action

      239557414

      0

      bad TCut

      rollback ROOT + FITS

      241599746

      352

      bad processing order

      rollback FITS

      245403855

      1019

      bad start time

      change start time in runList and rollback

      332661583

      16244

      silent root errors

      rollback ROOT

      339081502

      17416

      silent root errors

      rollback ROOT

    • After these actions, the dataCatalog tallies are now consistent:
      NameTypeFilesEventsSizeCreated

      Name

      Type

      Files

      Events

      Size

      Created (UTC)

      Links

      | |

      Group

      |

      20229

      |

      44,125,679,961

      |

      128.7 TB

      |

      25-Jan-2012 00:53:31

      | |

      ELECTRONFT1

      Group

      20229

      0

      8.5 GB

      02-Mar-2012 00:06:07

      Files

      ELECTRONMERIT

      Group

      20229

      90,904,582

      205.7 GB

      25-Jan-2012 00:53:32

      Files

      EXTENDEDFT1

      Group

      20229

      6,291,424,926

      574.7 GB

      02-Mar-2012 00:06:09

      Files

      EXTENDEDLS1

      Group

      20229

      6,291,424,926

      1,020.1 GB

      02-Mar-2012 00:06:09

      Files

      FILTEREDMERIT

      Group

      20229

      6,291,424,926

      5.3 TB

      25-Jan-2012 00:53:29

      Files

      FT1

      Group

      20229

      189,323,074

      17.8 GB

      02-Mar-2012 00:06:06

      Files

      GCR

      Group

      20229

      44,125,679,961

      942.7 GB

      25-Jan-2012 00:53:31

      Files

      LS1

      Group

      20229

      1,325,204,821

      215.3 GB

      02-Mar-2012 00:06:08

      Files

      MERIT

      Group

      20229

      44,125,679,961

      35.4 TB

      25-Jan-2012 00:53:30

      Files

      RECON

      Group

      20229

      44,125,679,961

      590.0 TB

      25-Jan-2012 00:53:33

      Files

...

<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="1dbe84fcebe5518d-435a3765-461c4f3f-b0769460-0331b302d5459e398f73ef7a"><ac:plain-text-body><![CDATA[

Data Product

destination

data content [1]

event selection [1]

makeFT1

gtselect

gtdiffrsp

gtmktime

]]></ac:plain-text-body></ac:structured-macro>

EXTENDEDFT1

SLAC

FT1variables

((FT1EventClass & 0x00003EFF)!=0)
pass7.6_Extended_cuts_L1

(tick)

(error)

(tick)

(tick)

FT1

FSSC+SLAC

FT1variables

'source' and above
EVENT_CLASS bits 2,3,4
evclass=2 filtered from EXTENDEDFT1

(error)

(tick)

(inherited)

(tick)

EXTENDEDLS1

SLAC

LS1variables

((FT1EventClass & 0x00003EFF)!=0)
pass7.6_Extended_cuts_L1

(tick)

(error)

(tick)

(tick)

LS1

FSSC+SLAC

LS1variables

'transient' and above
EVENT_CLASS bits 0,2,3,4
evclass=0 filtered from EXTENDEDLS1

(error)

(tick)

(inherited)

(tick)

ELECTRONFT1

SLAC

FT1variables

CTBParticleType==1
pass7.6_Electrons_cuts_L1

(tick)

(error)

(error)

(tick)

...