...
Location template:
Code Block |
---|
/glast/Data/Flight/Reprocess/<reprocessName>/<dataType>
|
Locations for P300:
Code Block |
---|
/glast/Data/Flight/Reprocess/P300/recon
/glast/Data/Flight/Reprocess/P300/gcr
/glast/Data/Flight/Reprocess/P300/relation/glast/Data/Flight/Reprocess/P300/merit
/glast/Data/Flight/Reprocess/P300/filteredmerit
/glast/Data/Flight/Reprocess/P300/electronmerit
/glast/Data/Flight/Reprocess/P300/ft1
/glast/Data/Flight/Reprocess/P300/extendedft1
/glast/Data/Flight/Reprocess/P300/electronft1
/glast/Data/Flight/Reprocess/P300/ls1
/glast/Data/Flight/Reprocess/P300/extendedls1
|
...
Note: 'procVer' is a field added to the file name (and the keyword "PROC_VER" in the primary header) added to the FFD 5/12/2010. Ref: http://fermi.gsfc.nasa.gov/ssc/dev/current_documents/Science_DP_FFD_RevA.pdf
Example:
Code Block |
---|
/glast/Data/Flight/Reprocess/P300/recon/r0239557414_v202_recon.root
|
...
Logical directory and group template:
Code Block |
---|
Data/Flight/Reprocess/<reprocessName>:<dataType>
|
...
Naming examples:
Code Block |
---|
Data/Flight/Reprocess/P300:RECON r0239557414
|
...
- Current performance results for the Pass8 code are on this page .
For 20,000 event clumps:
job step
average CPU time
processClump
183 min
mergeClumps
10 min
- Plot of job throughput as of 20130813
From the plot, one can see a processing rate of ~208 runs/day. Assuming 28500 total runs, this would mean a repro time of 137 days or 4.5 months. - Another plot showing the number of run scratch directories cleaned up per day:
...
- 8/1/2013 - Initial P300x-FITS task created. 10 trial runs processed. (See caveats above.)
8/7/2013 - First year of data run through the task, amounting to 5537 runs and 11790391606 events:
First run
239557417
2008-08-04 15:43:37
Last run
271850279
2009-08-13 09:57:59
8/28/2013 - Second year of data ready and processed -> extendedFT1. Note that 36 troublesome runs omitted from 1st year data were included in this sample. There should be no missing runs in this sample.
First run
239557417
2008-04-2008 15:43:37
Last run
302647722
2010-08-04 20:48:40
10,976 runs, 2,677,747,829 events, 234.7 GB
9/25/2013 - Third year of data ready.
First run
239557417
2008-04-2008 15:43:37
Last run
334184989
2011-08-04 21:09:47
This block contains 16,516 runs and 36,056,385,847 events, or an increase over year 2 of 5,540 runs.
Configuration
CAUTION: The following data describes the experimental P300x-FITS task, not the production task
Task Location | /nfs/farm/g/glast/u38/Reprocess-tasks/P300x-FITS |
Task Status | http://glast-ground.slac.stanford.edu/Pipeline-II/exp/Fermi/task.jsp?task=112641219 |
Input Data | MERIT (direct from P300-ROOT) |
spacecraft data | same as P300-ROOT |
Input Run List | ftp://ftp-glast.slac.stanford.edu/glast.u38/Reprocess-tasks/P300x-FITS/config/runList.txt |
evtClassDefs | untagged version from 20130801 |
eventClassMap | EvtClassDefs_P8.xml |
ScienceTools | 09-32-05 (7/30/2013) |
Code Variants | redhat5-x86_64-64bit-gcc41 & redhat6-x86_64-64bit-gcc44 (Optimized) |
Diffuse Model | based on contents of /afs/slac.stanford.edu/g/glast/ground/GLAST_EXT/diffuseModels/v2r0 /v3r0 |
Diffuse Response | N/A |
IRFs | N/A |
Output Data Products |
...