Page History

...

• 4/5/2012 - resume task. New goal is entire science dataset.
• 4/12/2012 - due to possible overload of sulky46/u18 writing a lot of core files, have introduced one change to processClumps.py: prepend "ulimit -c 0;" to gleam command to disable all core file generation. This starts approx with run 7605 (+/-).
• 5/9/2012 - major pipeline issue...shut down pipeline and allow to drain (due to tomorrow's major outage)
• 5/10/2012 - 13:40 outage over.
  • Update GR from 17-35-24-rp04 to 17-35-24-rp07 in which the only change is replacing the 5-minute xroot time-out with 8 hours. This change effective with stream 14314 and previously failed pieces of four other runs: 14247.6, 14273.23, 14274.8, 14231.9.
  • Leon advises that as of today, calibrations are valid only thru ~15 Dec 2011 (run 345574915) - which is somewhere around stream 18,400. He asks Sasha to produce more up-to-date calibs.
• 5/18/2012 - all calibrations now valid through 6 May 2012. No need to pause P202 task.
• 5/28/2012 - 15:30 Complete (through 31 March 2012)
  • Data Catalog summary:  

    Name	Type	Files	Events	Size	Created (UTC)	Links
    CAL	Group	20229	44,125,599,595	128.7 TB	25-Jan-2012 00:53:31	Files
    ELECTRONFT1	Group	5600	0	2.5 GB	02-Mar-2012 00:06:07	Files
    ELECTRONMERIT	Group	20229	90,904,582	205.7 GB	25-Jan-2012 00:53:32	Files
    EXTENDEDFT1	Group	5600	1,572,783,826	143.7 GB	02-Mar-2012 00:06:09	Files
    EXTENDEDLS1	Group	5600	1,572,783,826	255.0 GB	02-Mar-2012 00:06:09	Files
    FILTEREDMERIT	Group	20229	6,291,396,710	5.3 TB	25-Jan-2012 00:53:29	Files
    FT1	Group	5600	24,261,962	2.4 GB	02-Mar-2012 00:06:06	Files
    GCR	Group	20229	44,123,014,456	942.7 GB	25-Jan-2012 00:53:31	Files
    LS1	Group	5600	271,923,333	44.2 GB	02-Mar-2012 00:06:08	Files
    MERIT	Group	20229	44,125,679,961	35.4 TB	25-Jan-2012 00:53:30	Files
    RECON	Group	20229	44,123,612,977	590.0 TB	25-Jan-2012 00:53:33	Files

    There are discrepancies to track down!
  • Final trickleStream configuration:

    Code Block

    =============================================================================== TRICKLE PARMS =============================================================================== task = P202-ROOT maxRuns = 20229 firstStep = setupRun steps = [['/processRun processClump', 2000, 21], ['mergeClumps', 200, 1]] maxStreamsPerCycle = 20 timePerCycle = 300 ------DEBUG---------------- maxCycles = 0 chatter = False dryRun = False ===============================================================================

...

...