...
- 3/2/2012 - Define block 1 as the 776 runs in P202-ROOT block 1. Configure trickleStream and begin (14:08)
- 3/31/2012 - Define block 2 as 5600 runs. Reconfig trickleStream and begin (18:05)
- 4/01/2012 - Block 2 complete (most of the 4824 jobs completed in about six hours w/1000 job limit).
- 5/31/2012
- Discover stream 5599 (run 271999199) requires rollback - new MERIT file version (v203->v205).
- Regenerate runlist with 20,229 input MERIT files.
- Minor config change: twoClumpMin=False (formerly True, but caused unnecessary extra processClump dummy jobs)
- 6/5/2012 - Final cleanup
- Five runs are responsible for discrepant event tallies:
Run
Stream
Reason
Action
239557414
0
bad TCut
rollback ROOT + FITS
241599746
352
bad processing order
rollback FITS
245403855
1019
bad start time
change start time in runList and rollback
332661583
16244
silent root errors
rollback ROOT
339081502
17416
silent root errors
rollback ROOT
- After these actions, the dataCatalog tallies are now consistent:
Name
Type
Files
Events
Size
Created (UTC)
Links
Group
20229
0
8.5 GB
02-Mar-2012 00:06:07
Group
20229
44 90,125904,679,961 582
128 205.7 TB GB
25-Jan-2012 00:53:31 32
Group
20229
0
189,323,074
17.8 8.5 GB
02-Mar-2012 00:06:07 06
Group
20229
90 1,325,904204,582 821
205 215.7 3 GB
25 02-JanMar-2012 00:5306:32 08
Group
20229
6,291,424,926
574.7 GB
02-Mar-2012 00:06:09
Group
20229
6,291,424,926
1,020.1 GB
02-Mar-2012 00:06:09
Group
20229
6,291,424,926
5.3 TB
25-Jan-2012 00:53:29
Group
20229
189,323,074
17.8 GB
.3 TB
25-Jan 02-Mar-2012 00:0653:06 29
Group
20229
44,125,679,961
942 35.7 GB 4 TB
25-Jan-2012 00:53:31 30
Group
20229
1 44,325125,204679,821 961
215 590.3 GB 0 TB
02 25-MarJan-2012 00:0653:08 33
Group
20229
44,125,679,961
35 942.4 TB 7 GB
25-Jan-2012 00:53:30 31
Group
20229
44,125,679,961
590 128.0 7 TB
25-Jan-2012 00:53:33 31
- Five runs are responsible for discrepant event tallies:
Configuration
Task Location | /nfs/farm/g/glast/u38/Reprocess-tasks/P202-FITS |
Task Status | http://glast-ground.slac.stanford.edu/Pipeline-II/task.jsp?task=75031156 |
Input Data | MERIT (direct from P202-ROOT) |
spacecraft data | same as P202-ROOT |
Input Run List | ftp://ftp-glast.slac.stanford.edu/glast.u38/Reprocess-tasks/P202-FITS/config/runList.txt |
evtClassDefs | 00-19-04 (6/23/2011) |
eventClassMap | EvtClassDefs_P7V6.xml |
ScienceTools | 09-27-01 (2/15/2012) |
Code Variants | redhat5-i686-32bit-gcc41 (Optimized) |
Diffuse Model | based on contents of /afs/slac.stanford.edu/g/glast/ground/GLAST_EXT/diffuseModels/v2r0 |
Diffuse Response | 'source' using P7SOURCE_V6 IRF |
IRFs | P6V7, contained within ScienceTools release |
Output Data Products |
...
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="ee0befa7738b8fc4-4bee0ab7-43974cab-892498f9-27242a29e8fc16672a4a3521"><ac:plain-text-body><![CDATA[ | Data Product | destination | data content [1] | event selection [1] | makeFT1 | gtselect | gtdiffrsp | gtmktime | ]]></ac:plain-text-body></ac:structured-macro> |
---|---|---|---|---|---|---|---|---|---|
EXTENDEDFT1 | SLAC | FT1variables | ((FT1EventClass & 0x00003EFF)!=0) | | | | | ||
FT1 | FSSC+SLAC | FT1variables | 'source' and above | | | (inherited) | | ||
EXTENDEDLS1 | SLAC | LS1variables | ((FT1EventClass & 0x00003EFF)!=0) | | | | | ||
LS1 | FSSC+SLAC | LS1variables | 'transient' and above | | | (inherited) | | ||
ELECTRONFT1 | SLAC | FT1variables | CTBParticleType==1 | | | | |
...