status: Running Complete
last update: 13 May 26 June 2014
This page is a record of the configuration and execution of the P300 reprocessing project, full reprocessing from DIGIs using Pass8 analysis code.
...
- 4/8/2015 - Setup Block 5, data from 1 Feb 2015 through 7 Apr 2015 penultimatebackfill
- Last run Block 4 = 444436565 2015-01-31 22:36:02
- First run Block 5 = 444442524 2015-02-01 00:15:21
- Last run Block 5 = 450142738 2015-04-07 23:38:55
- Total number of P300-ROOT runs = 37023
- Number of additional runs in block 5 = 1003
4/16/2015 - Block 5 complete. Summary from dataCatalog:
- 6/4/2015 - Setup and start Block 6, through 6/3/2015
Last run of Block 5: 450142738 (2015-04-07 23:38:55)
First run of Block 6: 450148449 (2015-04-08 01:14:06)
Last run of Block 6: 455062807 (2015-06-03 22:20:04)Total runs in combined runList = 37888 (formerly 37023)
Total new runs in Block 6 = 865
6/10/2015 - Block 6 complete. Summary from dataCatalog:
- 6/24/2015 - Setup and start Block 7, the final block of P300 reprocessing:
- Last run of Block 6: 455062807 (2015-06-03 22:20:04)
- First run of Block 7: 455069221 (2015-06-04 00:06:58)
- Last run of Block 7: 456829490 (2015-06-24 09:04:47)
- First run of Level 1: 456835199 (2015-06-24 10:39:56)
Total runs in full reprocessing task = 38198
Total new runs in Block 7 = 310
6/26/2015 - Block 7 – and entire task – COMPLETE
Name Files Events Size Created (UTC) GCR 38198 82,812,280,309 1.5 TB 09-May-2013 22:22:18 MERIT 38198 82,812,280,309 138.5 TB 09-May-2013 22:22:18 RECON 38198 82,812,280,309 1.1 PB 09-May-2013 22:22:20 RELATION 38198 82,812,280,309 10.8 TB 09-May-2013 22:22:20 8/2/2015 Emergency reprocess of 40 runs that were Level 1 processed with bad CAL calibrations
Former (block7) run consisted of 38198 runs.
New (block8) run consists of 38238 runs.
There are 40 new runs to reprocess.
First new run 459716687
Last new run 459941302
Starting point of pipeline task P300-ROOT (v1.1): 11269
Configuration
Task Location | /nfs/farm/g/glast/u38/Reprocess-tasks/P300-ROOT |
Task Version | 1.0 (streams 0-26928), 1.1 (streams 26929-end) |
Task Status | |
GlastRelease | 20-09-00 streams 0 - 5970 (02 Jul 2013) |
Run Selection | based on a modified "standard" selection, see https://confluence.slac.stanford.edu/display/SCIGRPS/Official+LAT+Datasets |
s/c data | P202 FT2SECONDS which will eventually become a "standard" Public Release https://confluence.slac.stanford.edu/display/SCIGRPS/Official+LAT+Datasets |
Input Run List | ftp://ftp-glast.slac.stanford.edu/glast.u38/Reprocess-tasks/P300-ROOT/config/runList.txt |
photonFilter | Not yet applicable, although this is defined by default: CTBParticleType==1 && ((FT1EventClass & 0x00003EFF)!=0) NOTE: task P301-MERIT regenerates MERIT files from P300 MERIT files using TMineExt, updating the event classification data |
electronFilter | Not yet applicable, although this is defined by default: CTBParticleType==1 |
Code Variants | redhat5-i686-32bit-gcc41 (Optimized), note that rhel5-64 and rhel6-64 GR builds are not yet available |
jobOpts | ftp://ftp-glast.slac.stanford.edu/glast.u38/Reprocess-tasks/P300-ROOT/config/Pass8Recon.txt |
calibrations & alignments | "p7repro" and "L1current" (the latter to conform with new Level 1 flavor, and to include new ACD calibration for 9 Sep 2012) |
Output Data Products | RECON, GCR, RELATION, MERIT, FILTEREDMERIT, ELECTRONMERIT (but note that FILTEREDMERIT and ELECTRONMERIT are empty or contain junk) |
...