...
calibUtil v1r6: H
- jrb Add new dtd for Acd calibs & a couple sample files
Wiki Markup
- fewtrel: fixed stupid bug in MuonCalib::readAsymTXT(), probably introduced when I added tower info to output txt files in v3r9
\
- dwood/fewtrell XML parser - switched base XML parser from python standard (minidom) to PyXML pacakage (4DOM)
\
- dwood/fewtrell allows for DTD validation:
- DTD validation is now enabled for XML files required to have DTD information prefixed
- DTD validation still disabled for XML files which have no DTD yet
- better for quality control, but quite a bit slower
\- dwood/fewtrell adcsmooth - numerous changes to work correctly with sparsely sampled characterization data
\- dwood/fewtrell extrapolate data near the pedestal noise region; promotes sharp cutoff at low end of curves
\- dwood/fewtrell LAC pedestal noise is zeroed out:
- smoothing filter does not run at endpoints of curves; promotes sharp cutoff
- better extrapolation of FLE coarse range values past measurement range
- special processing for ULD data to reconstruct saturation plateau with sparse data
\- dwood/fewtrell charplot - new utility to plot raw and smoothed characterization data. Mainly a tool to diagnose the output of adcsmooth
\- dwood/fewtrell charVal - new validation application for characterization data XML files. Will catch gross errors, but probably still needs work to improve validation criteria
\- dwood/fewtrell dacVal - new validation application for DAC settings XML files:
- works backwards from DAC setttings to calculate threshold in energy units
- requires a complete set of files to run
- nothing yet for ULD
\- dwood/fewtrell adc2nrgVal - fixed bug with ROOT output option
\- dwood/fewtrell xxxXML2TXT.py - new scripts generate collumnar text files from offline Cal calibration files
\- dwood/fewtrell dacDiff.py - generates per channel differences between any 2 cal dac settings snapshot files.
\- dwood/fewtrell roothist2csv.py - generates collumnar text files from all histograms in ROOT file.
\- dwood/fewtrell dumpROOTPlots.py - generates images files for all histograms & Canvases in ROOT file.
\- dwood/fewtrell unit_test - now 2 tower instead of 8 to save processing time
\- dwood/fewtrell runSuiteParallel.py - now supports commandline override of twr_id as well as each individual processing phase. Allows work to be easily broken up into several threads w/ same cfg file.
\- dwood/fewtrell C+\+ - TXT format output now supports new format used by python scripts. improved format includes tower information & contains all 4 asym types & both MeVPerDAC types into single file each.
\- fewtrell C+\+ apps now use TH1S instead of TH1F across board. Results are the same & it saves memory
\- fewtrell future updates w/ 16 tower support will use a lot of memory so this is important step. C+\+ apps now use float instead of double in most places. the precision is not needed & it saves some memory, particularly in larger arrays.
\- fewtrell All python scripts now have .bat & .sh shell launcher scripts. All .sh scripts have executable bit set.
\- fewtrell runSuiteParallel.py, gensettings.py, build_adcsmooth.py all generate appropriate validation outputs along w/ their primary output.
\- dwood/fewtrell For DAC settings XML file produced from genXXXsettings tools, modified the values of the element 'hierarchy' and 'shape' attributes. Hierarchy is set to the value '\
- DTD validation is now enabled for XML files required to have DTD information prefixed
- DTD validation still disabled for XML files which have no DTD yet
- better for quality control, but quite a bit slower
- dwood/fewtrell adcsmooth - numerous changes to work correctly with sparsely sampled characterization data
- dwood/fewtrell extrapolate data near the pedestal noise region; promotes sharp cutoff at low end of curves
- dwood/fewtrell LAC pedestal noise is zeroed out:
- smoothing filter does not run at endpoints of curves; promotes sharp cutoff
- better extrapolation of FLE coarse range values past measurement range
- special processing for ULD data to reconstruct saturation plateau with sparse data
- dwood/fewtrell charplot - new utility to plot raw and smoothed characterization data. Mainly a tool to diagnose the output of adcsmooth
- dwood/fewtrell charVal - new validation application for characterization data XML files. Will catch gross errors, but probably still needs work to improve validation criteria
- dwood/fewtrell dacVal - new validation application for DAC settings XML files:
- works backwards from DAC setttings to calculate threshold in energy units
- requires a complete set of files to run
- nothing yet for ULD
- dwood/fewtrell adc2nrgVal - fixed bug with ROOT output option
- dwood/fewtrell xxxXML2TXT.py - new scripts generate collumnar text files from offline Cal calibration files
- dwood/fewtrell dacDiff.py - generates per channel differences between any 2 cal dac settings snapshot files.
- dwood/fewtrell roothist2csv.py - generates collumnar text files from all histograms in ROOT file.
- dwood/fewtrell dumpROOTPlots.py - generates images files for all histograms & Canvases in ROOT file.
- dwood/fewtrell unit_test - now 2 tower instead of 8 to save processing time
- dwood/fewtrell runSuiteParallel.py - now supports commandline override of twr_id as well as each individual processing phase. Allows work to be easily broken up into several threads w/ same cfg file.
- dwood/fewtrell C++ - TXT format output now supports new format used by python scripts. improved format includes tower information & contains all 4 asym types & both MeVPerDAC types into single file each.
- fewtrell C++ apps now use TH1S instead of TH1F across board. Results are the same & it saves memory
- fewtrell future updates w/ 16 tower support will use a lot of memory so this is important step. C++ apps now use float instead of double in most places. the precision is not needed & it saves some memory, particularly in larger arrays.
- fewtrell All python scripts now have .bat & .sh shell launcher scripts. All .sh scripts have executable bit set.
- fewtrell runSuiteParallel.py, gensettings.py, build_adcsmooth.py all generate appropriate validation outputs along w/ their primary output.
- dwood/fewtrell For DAC settings XML file produced from genXXXsettings tools, modified the values of the element 'hierarchy' and 'shape' attributes. Hierarchy is set to the value '['GCCC','GCRC','GCFE',''\]' and shape is set to the value '(8,2,12)'.
\-
- dwood/fewtrell Added support to tools for handling LEX1 energy range FLE DAC characterization files. Currently, a simple scale factor is used to convert to LEX8 ADC units and process as before.
\
- dwood/fewtrell Better file type checking for files which use the ADC/DAC XML tables as input.
\-
- dwood/fewtrell Muon asymmetry now smarter for cross diode asymmetry. Uses average ratio of Large2Small diode signal instead of the slope. This will make energy & position response @ 1 GeV \ +\- 100 MeV better.
\-
- dwood/fewtrell runCIFit can now process broadcast mode calibGen as well as the older, 1 column at a time method.
\-
- dwood/fewtrell uldVal: new application to validate ULD DAC settings XML files (from genULDsettings)
\-
- dwood/fewtrell dacVal:
- fixed report of FAILED tests
- relaxed FHE error and warning limits
\- dwood/fewtrell charVal:
- added support for ULD characterization files
- added check for incorrect pedestal subtraction
- relaxed FHE and LAC error and warning limits
\- dwood/fewtrell build_adcsmooth: added call to charVal to do validation on ULD characterization files
\- dwood/fewtrell gensettings:
- added call to uldVal to do validation on ULD DAC settings files
- fixed bug which put 'cp' instead of 'copy' in Windows BAT output files
- made processing of muon gain FHE files optional; command line \-m or \--muon
\- dwood/fewtrell build_tholdci_cfg: make sure FHE threshold is properly converted from GeV to MeV
\- dwood/fewtrell runSuiteParallel: fixed undefined environment variable error
\- dwood Added titles and axes labels to ROOT output graphs generated by plot and validation scripts
\- dwood genULDsettings - removed one DAC step safety margin; output margins are closer now to user requested value
\- dwood uldVal:
- look at all energy ranges when comparing threshold to saturation level
- add check to make sure (saturation - threshold) is not less than margin paramter
- tholdCIVal - removed check of FLE threshold verses LEX8 ULD value; not needed now that FLE data is LEX1
\- fewtrell fixed bug introduced w/ broadcast mode in
- fixed report of FAILED tests
- relaxed FHE error and warning limits
- dwood/fewtrell charVal:
- added support for ULD characterization files
- added check for incorrect pedestal subtraction
- relaxed FHE and LAC error and warning limits
- dwood/fewtrell build_adcsmooth: added call to charVal to do validation on ULD characterization files
- dwood/fewtrell gensettings:
- added call to uldVal to do validation on ULD DAC settings files
- fixed bug which put 'cp' instead of 'copy' in Windows BAT output files
- made processing of muon gain FHE files optional; command line -m or --muon
- dwood/fewtrell build_tholdci_cfg: make sure FHE threshold is properly converted from GeV to MeV
- dwood/fewtrell runSuiteParallel: fixed undefined environment variable error
- dwood Added titles and axes labels to ROOT output graphs generated by plot and validation scripts
- dwood genULDsettings - removed one DAC step safety margin; output margins are closer now to user requested value
- dwood uldVal:
- look at all energy ranges when comparing threshold to saturation level
- add check to make sure (saturation - threshold) is not less than margin paramter
- tholdCIVal - removed check of FLE threshold verses LEX8 ULD value; not needed now that FLE data is LEX1
- fewtrell fixed bug introduced w/ broadcast mode in v3r9p
calibGenACD v1r4p1: T
- EAC Fix a spurious include in cmt/requirements
- EAC Added runMuonCalib_Svac.cxx to run mip peak calibrations on SVAC ntuple files.
- EAC Make changes so that xml format agrees with the dtd file that joanne has
- EAC Remove a dead src/runMuonCalib_Roi.cxx file which was moved to apps subdir
- EAC Initilize pedestal file to zero to prevent crash if it don't exist
- EAC Fairly big update, added AcdMeritCalib, changed the structure a bit.
- EAC Fairly big update, added AcdVetoCalib, changed the structure a bit.
- EAC Minor update. Add information about the datasets used to generate calibrations to the txt and xml output files. Also, added apps/ subdir for application main() routines.
- EAC Major re-write. Brings in some code from the ACD. Uses polynomials to smooth pha distributions and find the peak values. Uses a simple algorithm to decide what range to fit over. Supports both ped-subtracted and raw values.
...
svac pipeline code and tasks:
code/tasks v3r5p9:
pipelineDatasets v0r3
ISOC code and tasks:
v0r5p0
Apps that run in pipeline:
eLog: v2r3p1
ConfigTables: v3r2p1
v3r6p0:
Make LicosLaunch die if run directory isn't in rawData.
More & better timestamps in recon chunk script.
Put output from each chunk in a separate subdir of staging dir.
Merge chunks into staging dir, then move merged files to destination.
Merge recon chunks before merit & cal.
Use new AFS staging dir.
Switch rootData to u34.
Split recon/recon into 6 processes to get better rollback granularity.
When recon of some chunks fail, save the output from the successful ones and don't re-run them.
# Don't do merge on single-chunk recon runs. # Disabled! - do do merge.
All file copies & moves performed by recon are attempted up to 5 times, then fail (used to try until the job timed out on copies to local disk, and only once for moves away from local disk or staging).
pipelineDatasets v0r3
ISOC code and tasks:
v0r5p0
Apps that run in pipeline:
eLog: v2r3p1
ConfigTables: v3r2p1
TestReport: v3r6p4 (digi & recon reportsTestReport: v3r6p1 (digi & recon reports): EAC and awb
- Added ACD electronics space and ACD trigger quantities. Also improved descriptions.
- Protect code against time hacks being the same in two events.
- Get GEM discarded counter from context information instead of directly from the GEM.
- Added number of prescaled and dead zone events. Added histogram with delta deadzone events.
- Added check on the consistency between the GEM sequence counter and the number of events in the digi file.
- Added number of prescaled and dead zone eventstrigger/deadzone/discarded rates for 30 time intervals. In case of problems it may tell us where in a run it happened and speed up troubleshooting.
- Added consistency check on the consistency between the GEM sequence counter and the number of events in the digi fileall extended counters so we'll know when the go backwards.
- Added much better error decoding. Will now know what the TEM errors are (TKR FIFO full or not).
- Added trigger /deadzone/discarded rates for 30 time intervals. In case of problems it may tell us where in a run it happened and speed up troubleshooting.
- Added consistency check on all extended counters so we'll know when the go backwards.
- Added much better error decoding. Will now know what the TEM errors are (TKR FIFO full or not).
- Added trigger arrival time histograms.
- Added ACD MIP peak histograms.
EngineeringModelRoot: v2r2 (SVAC tuple)
- Added a few useful AcdMips variables (sum and max and error flag).
- Added more error flags.
- Updated documention.
arrival time histograms.
- Added ACD MIP peak histograms.
EngineeringModelRoot: v2r2 (SVAC tuple)
- Added a few useful AcdMips variables (sum and max and error flag).
- Added more error flags.
- Updated documention.
Approved: unanimous (Bill not available) - 5/19/06
Added 06.01.2006 for book keeping purposes (for the moment): Bryson's CHS task
- Bryson IExternal/fsw v0r069 -- incorporates DFI, etc. from FSW B0-6-9 with the 24/25-bit fix for the livetime counter.
- Bryson CHS/eventFile v1r0p9 -- bunch of tweaks mostly to rqts file for building on Windows.
- Bryson CHS v2r2 -- updated checkout package to pull in these two new tags.
Approved: